Max level shown:
12025-01-16T20:00:02.683ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2804 local_addr = [fd00:1122:3344:101::c]:49474 method = GET remote_addr = [fd00:1122:3344:101::d]:39316 req_id = bbe4f282-7b01-4d09-8734-501a640904c4 response_code = 200 uri = /3c6582d4-0e42-407f-bc66-e913ef1c0f57
22025-01-16T20:00:02.837ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
32025-01-16T20:00:02.837ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
42025-01-16T20:00:02.837ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
52025-01-16T20:00:02.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62025-01-16T20:00:02.837ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
72025-01-16T20:00:02.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82025-01-16T20:00:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92025-01-16T20:00:02.838ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
102025-01-16T20:00:02.838ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
112025-01-16T20:00:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122025-01-16T20:00:02.838ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
132025-01-16T20:00:02.838ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
142025-01-16T20:00:02.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
152025-01-16T20:00:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
162025-01-16T20:00:02.838ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
172025-01-16T20:00:02.838ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
182025-01-16T20:00:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
192025-01-16T20:00:02.838ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
202025-01-16T20:00:02.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
212025-01-16T20:00:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
222025-01-16T20:00:02.838ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
232025-01-16T20:00:02.838ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
242025-01-16T20:00:02.838ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
252025-01-16T20:00:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
262025-01-16T20:00:02.838ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
272025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
282025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
292025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
302025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
312025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
322025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
332025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
342025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
352025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
362025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
372025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
382025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
392025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
402025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
412025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
422025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
432025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
442025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
452025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
462025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
472025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
482025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
492025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
502025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
512025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
522025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
532025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
542025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
552025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
562025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
572025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
582025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
592025-01-16T20:00:02.839ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
602025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
612025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
622025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
632025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
642025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
652025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
662025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
672025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
682025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
692025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
702025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
712025-01-16T20:00:02.840ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-16 19:50:02.840144579 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
722025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
732025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
742025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
752025-01-16T20:00:02.840ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8
762025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.751\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"39de0ab7-8c61-46aa-88f2-d42db34dffb8"}
772025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
782025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
792025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
802025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
812025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
822025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
832025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
842025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
852025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
862025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
872025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
882025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
892025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
902025-01-16T20:00:02.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
912025-01-16T20:00:02.841ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1673b82a-d301-40a0-97f5-01c1919bcccc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a78ec168-75b0-4c15-b272-0f34e450b715.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fc5e4155-1b26-42b3-8db4-a4cf6dd61fe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fc5e4155-1b26-42b3-8db4-a4cf6dd61fe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1561, tv_nsec: 74898415 } })
922025-01-16T20:00:02.841ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("67baed66-640b-413d-8436-22e580c71fff.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b6525081-e08a-4759-918e-50f60ff0f6f1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b6525081-e08a-4759-918e-50f60ff0f6f1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1561, tv_nsec: 75096528 } })
932025-01-16T20:00:02.842ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
942025-01-16T20:00:02.843ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
952025-01-16T20:00:02.843ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 5.726071ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
962025-01-16T20:00:02.843ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
972025-01-16T20:00:02.843ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.256317ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
982025-01-16T20:00:02.844ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
992025-01-16T20:00:02.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1002025-01-16T20:00:02.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1012025-01-16T20:00:02.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1022025-01-16T20:00:02.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1032025-01-16T20:00:02.848ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1561, tv_nsec: 82204743 } })
1042025-01-16T20:00:02.849ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
1052025-01-16T20:00:02.851ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1062025-01-16T20:00:02.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1072025-01-16T20:00:02.851ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1082025-01-16T20:00:02.851ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1092025-01-16T20:00:02.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1102025-01-16T20:00:02.852ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1112025-01-16T20:00:02.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1122025-01-16T20:00:02.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.316211ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
1132025-01-16T20:00:02.853ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
1142025-01-16T20:00:02.853ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1152025-01-16T20:00:02.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1162025-01-16T20:00:02.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1172025-01-16T20:00:02.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1182025-01-16T20:00:02.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1192025-01-16T20:00:02.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
1202025-01-16T20:00:02.854ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1212025-01-16T20:00:02.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1222025-01-16T20:00:02.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1232025-01-16T20:00:02.857ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1242025-01-16T20:00:02.858ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1252025-01-16T20:00:02.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1262025-01-16T20:00:02.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1272025-01-16T20:00:02.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1282025-01-16T20:00:02.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1292025-01-16T20:00:02.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
1302025-01-16T20:00:02.860ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1312025-01-16T20:00:02.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1322025-01-16T20:00:02.862ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1332025-01-16T20:00:02.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1342025-01-16T20:00:02.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1352025-01-16T20:00:02.864ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1561, tv_nsec: 97235226 } })
1362025-01-16T20:00:02.864ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 24.243405ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1372025-01-16T20:00:02.864ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
1382025-01-16T20:00:02.865ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 25.715351ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
1392025-01-16T20:00:02.865ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
1402025-01-16T20:00:02.865ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
1412025-01-16T20:00:02.865ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 26.215109ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
1422025-01-16T20:00:02.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1432025-01-16T20:00:02.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1442025-01-16T20:00:02.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1452025-01-16T20:00:02.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1462025-01-16T20:00:02.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1472025-01-16T20:00:02.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1482025-01-16T20:00:02.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1492025-01-16T20:00:02.871ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-16 19:50:02.840144579 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
1502025-01-16T20:00:02.871ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 30.916703ms iteration = 12 status = {"expiration":"2025-01-16T19:50:02.840144579Z","pruned":[]}
1512025-01-16T20:00:02.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1522025-01-16T20:00:02.873ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1532025-01-16T20:00:02.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1542025-01-16T20:00:02.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1552025-01-16T20:00:02.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1562025-01-16T20:00:02.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1572025-01-16T20:00:02.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1582025-01-16T20:00:02.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.357133ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1592025-01-16T20:00:02.877ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1602025-01-16T20:00:02.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1612025-01-16T20:00:02.878ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1622025-01-16T20:00:02.878ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1632025-01-16T20:00:02.878ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1642025-01-16T20:00:02.878ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
1652025-01-16T20:00:02.878ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1662025-01-16T20:00:02.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1672025-01-16T20:00:02.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1682025-01-16T20:00:02.880ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1692025-01-16T20:00:02.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1702025-01-16T20:00:02.885ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1712025-01-16T20:00:02.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1722025-01-16T20:00:02.886ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1732025-01-16T20:00:02.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1742025-01-16T20:00:02.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1752025-01-16T20:00:02.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1762025-01-16T20:00:02.887ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1772025-01-16T20:00:02.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1782025-01-16T20:00:02.889ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1792025-01-16T20:00:02.890ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1802025-01-16T20:00:02.890ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1561, tv_nsec: 123569698 } })
1812025-01-16T20:00:02.890ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f
1822025-01-16T20:00:02.892ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1832025-01-16T20:00:02.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1842025-01-16T20:00:02.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
1852025-01-16T20:00:02.893ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1862025-01-16T20:00:02.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1872025-01-16T20:00:02.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
1882025-01-16T20:00:02.894ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1892025-01-16T20:00:02.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1902025-01-16T20:00:02.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1912025-01-16T20:00:02.898ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1922025-01-16T20:00:02.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1932025-01-16T20:00:02.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 39de0ab7-8c61-46aa-88f2-d42db34dffb8, lookup_type: ById(39de0ab7-8c61-46aa-88f2-d42db34dffb8) } result = Ok(())
1942025-01-16T20:00:02.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1952025-01-16T20:00:02.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1962025-01-16T20:00:02.910ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1972025-01-16T20:00:02.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1982025-01-16T20:00:02.914ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 original_time_created = 2025-01-16 19:48:51.140214 UTC target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 time_created = 2025-01-16 19:48:51.140214 UTC
1992025-01-16T20:00:02.915ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 75.472534ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"39de0ab7-8c61-46aa-88f2-d42db34dffb8","time_created":"2025-01-16T19:48:51.140214Z"}
2002025-01-16T20:00:02.915ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2012025-01-16T20:00:02.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2022025-01-16T20:00:02.917ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 78.64588ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2032025-01-16T20:00:02.925ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2042025-01-16T20:00:02.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2052025-01-16T20:00:02.928ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2062025-01-16T20:00:02.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2072025-01-16T20:00:02.929ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 89.052812ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
2082025-01-16T20:00:02.931ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2092025-01-16T20:00:02.931ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
2102025-01-16T20:00:02.931ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
2112025-01-16T20:00:02.932ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 93.398819ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
2122025-01-16T20:00:02.932ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2132025-01-16T20:00:02.934ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2142025-01-16T20:00:02.935ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 87207105-a825-4eaa-ac6d-6aaa586b0fc5, lookup_type: ById(87207105-a825-4eaa-ac6d-6aaa586b0fc5) } result = Ok(())
2152025-01-16T20:00:02.935ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2162025-01-16T20:00:02.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2172025-01-16T20:00:02.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2182025-01-16T20:00:02.937ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 97.566512ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
2192025-01-16T20:00:02.939ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2202025-01-16T20:00:02.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2212025-01-16T20:00:02.942ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2222025-01-16T20:00:02.942ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2232025-01-16T20:00:02.942ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 102.238584ms iteration = 23 status = 0
2242025-01-16T20:00:02.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2252025-01-16T20:00:02.943ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
2262025-01-16T20:00:02.943ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 103.894583ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
2272025-01-16T20:00:02.944ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2282025-01-16T20:00:02.944ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2292025-01-16T20:00:02.944ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 106.058441ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2302025-01-16T20:00:02.944ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
2312025-01-16T20:00:02.944ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
2322025-01-16T20:00:02.944ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
2332025-01-16T20:00:02.944ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2342025-01-16T20:00:02.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2352025-01-16T20:00:02.946ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2362025-01-16T20:00:02.950ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2372025-01-16T20:00:02.950ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2382025-01-16T20:00:02.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2392025-01-16T20:00:02.954ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
2402025-01-16T20:00:02.954ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f05be43b-5d84-4b95-99be-d6d0a1e3a923 dns_zone_name = oxide.test found_so_far = 0 version = 2
2412025-01-16T20:00:02.954ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2422025-01-16T20:00:02.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2432025-01-16T20:00:02.954ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2442025-01-16T20:00:02.954ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2452025-01-16T20:00:02.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2462025-01-16T20:00:02.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2472025-01-16T20:00:02.956ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2482025-01-16T20:00:02.957ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2492025-01-16T20:00:02.960ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2502025-01-16T20:00:02.960ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2512025-01-16T20:00:02.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2522025-01-16T20:00:02.960ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2532025-01-16T20:00:02.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2542025-01-16T20:00:02.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2552025-01-16T20:00:02.962ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2562025-01-16T20:00:02.963ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
2572025-01-16T20:00:02.963ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 125.046294ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
2582025-01-16T20:00:02.964ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f05be43b-5d84-4b95-99be-d6d0a1e3a923 dns_zone_name = oxide.test found_so_far = 1 version = 2
2592025-01-16T20:00:02.964ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
2602025-01-16T20:00:02.964ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-16 19:49:10.849798 UTC dns_group = external generation = 2
2612025-01-16T20:00:02.964ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 124.566775ms iteration = 13 status = {"generation":2}
2622025-01-16T20:00:02.964ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2632025-01-16T20:00:02.964ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2642025-01-16T20:00:02.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2652025-01-16T20:00:02.967ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2662025-01-16T20:00:02.969ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2672025-01-16T20:00:02.969ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2682025-01-16T20:00:02.969ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 129.870599ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2692025-01-16T20:00:02.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2702025-01-16T20:00:02.971ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
2712025-01-16T20:00:02.987ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
2722025-01-16T20:00:02.987ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2732025-01-16T20:00:02.987ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "208a24b0-be73-47a5-bac9-6c3864ba97db", "content-length": "26", "date": "Thu, 16 Jan 2025 20:00:02 GMT"} })
2742025-01-16T20:00:02.987ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2752025-01-16T20:00:02.989ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
2762025-01-16T20:00:02.993ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
2772025-01-16T20:00:02.993ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
2782025-01-16T20:00:02.993ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
2792025-01-16T20:00:02.993ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2802025-01-16T20:00:02.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2812025-01-16T20:00:02.996ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2822025-01-16T20:00:02.997ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2832025-01-16T20:00:03.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2842025-01-16T20:00:03.000ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2852025-01-16T20:00:03.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2862025-01-16T20:00:03.022ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-16T19:48:57.779461Z, time_modified: 2025-01-16T19:48:57.779461Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, db_silo: Silo { identity: SiloIdentity { id: 197fa9bd-2b54-417a-8249-a5354e078485, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T19:49:10.527303Z, time_modified: 2025-01-16T19:49:10.527303Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b24122d5f92c7bd84d282bd8841cee73a1e4d9ad23f30c8a432049fc1b2c4538" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, db_silo: Silo { identity: SiloIdentity { id: 197fa9bd-2b54-417a-8249-a5354e078485, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T19:49:10.527303Z, time_modified: 2025-01-16T19:49:10.527303Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b24122d5f92c7bd84d282bd8841cee73a1e4d9ad23f30c8a432049fc1b2c4538" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
2872025-01-16T20:00:03.022ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 184.239003ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"197fa9bd-2b54-417a-8249-a5354e078485","tls_certs":["b24122d5f92c7bd84d282bd8841cee73a1e4d9ad23f30c8a432049fc1b2c4538"]}},"default_endpoint":{"silo_id":"197fa9bd-2b54-417a-8249-a5354e078485","tls_certs":["b24122d5f92c7bd84d282bd8841cee73a1e4d9ad23f30c8a432049fc1b2c4538"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
2882025-01-16T20:00:03.071ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
2892025-01-16T20:00:03.071ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2902025-01-16T20:00:03.071ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9a1b6d8-06d3-4bac-809e-d423fb4e3b41", "content-length": "26", "date": "Thu, 16 Jan 2025 20:00:02 GMT"} })
2912025-01-16T20:00:03.071ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2922025-01-16T20:00:03.074ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2932025-01-16T20:00:03.101ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 262.71154ms iteration = 26 status = {"physical_disks_added":0}
2942025-01-16T20:00:03.125ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/92a6af21-e052-40a2-a996-c243f3f872d8/state
2952025-01-16T20:00:03.145ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f zone_address = fd00:1122:3344:101::2
2962025-01-16T20:00:03.145ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2972025-01-16T20:00:03.145ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "25821c74-dc2d-48e0-91a0-4eca85e335d3", "content-length": "26", "date": "Thu, 16 Jan 2025 20:00:02 GMT"} })
2982025-01-16T20:00:03.145ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2992025-01-16T20:00:03.147ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 26dc04a7-8537-47d8-965d-0931849f651f
3002025-01-16T20:00:03.191ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
3012025-01-16T20:00:03.191ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c7609a7-a652-4aca-a75c-5231f2950d3c", "content-length": "1", "date": "Thu, 16 Jan 2025 20:00:02 GMT"} })
3022025-01-16T20:00:03.193ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3032025-01-16T20:00:03.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3042025-01-16T20:00:03.205ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/92a6af21-e052-40a2-a996-c243f3f872d8/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2d436ff-17c0-4241-946f-c393705aabf5", "content-length": "130", "date": "Thu, 16 Jan 2025 20:00:03 GMT"} })
3052025-01-16T20:00:03.205ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 3de40729-f38e-405c-b30f-63d86ff0cdd0 sled_id = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-16T20:00:00.544490998Z }, migration_in: None, migration_out: None } vmm_id = 92a6af21-e052-40a2-a996-c243f3f872d8
3062025-01-16T20:00:03.205ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2077 instance_id = 3de40729-f38e-405c-b30f-63d86ff0cdd0 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 92a6af21-e052-40a2-a996-c243f3f872d8 sled_id = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 vmm_id = 92a6af21-e052-40a2-a996-c243f3f872d8 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-16T20:00:00.544490998Z }
3072025-01-16T20:00:03.205ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 3de40729-f38e-405c-b30f-63d86ff0cdd0 roles = RoleSet { roles: {} } sled_id = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 vmm_id = 92a6af21-e052-40a2-a996-c243f3f872d8
3082025-01-16T20:00:03.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 3de40729-f38e-405c-b30f-63d86ff0cdd0 resource = Database result = Ok(()) sled_id = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 vmm_id = 92a6af21-e052-40a2-a996-c243f3f872d8
3092025-01-16T20:00:03.226ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
3102025-01-16T20:00:03.227ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c081884-f5ff-45af-87e4-6018d9ec48d5", "content-length": "809", "date": "Thu, 16 Jan 2025 20:00:02 GMT"} })
3112025-01-16T20:00:03.227ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(305239) }} sled = buskin
3122025-01-16T20:00:03.227ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
3132025-01-16T20:00:03.227ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
3142025-01-16T20:00:03.228ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3152025-01-16T20:00:03.228ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 388.67128ms iteration = 24 status = {}
3162025-01-16T20:00:03.228ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3172025-01-16T20:00:03.241ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 401.558117ms iteration = 23 status = {}
3182025-01-16T20:00:03.246ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
3192025-01-16T20:00:03.246ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a6483439-1ed5-4e47-8eff-891a826950b1", "date": "Thu, 16 Jan 2025 20:00:02 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3202025-01-16T20:00:03.246ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3212025-01-16T20:00:03.248ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f50d97b7-1061-4c80-b483-1dd5a285763b", "date": "Thu, 16 Jan 2025 20:00:02 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3222025-01-16T20:00:03.248ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3232025-01-16T20:00:03.250ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
3242025-01-16T20:00:03.250ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 410.105646ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
3252025-01-16T20:00:03.293ZINFOnexus (BackgroundTasks): VPC route manager sled 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
3262025-01-16T20:00:03.293ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3272025-01-16T20:00:03.294ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2580775-0706-443e-91ff-c0be5ca83fb3", "content-length": "581", "date": "Thu, 16 Jan 2025 20:00:02 GMT"} })
3282025-01-16T20:00:03.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3292025-01-16T20:00:03.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3302025-01-16T20:00:03.295ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
3312025-01-16T20:00:03.295ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3322025-01-16T20:00:03.295ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 481516d2-3f4d-4dc5-9036-8c14a1fa4fd7 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3332025-01-16T20:00:03.295ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3342025-01-16T20:00:03.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3352025-01-16T20:00:03.296ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 458.460075ms iteration = 23 status = null
3362025-01-16T20:00:03.297ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3372025-01-16T20:00:03.297ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3382025-01-16T20:00:03.297ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3392025-01-16T20:00:03.300ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3402025-01-16T20:00:03.300ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3412025-01-16T20:00:03.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3422025-01-16T20:00:03.301ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
3432025-01-16T20:00:03.302ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 481516d2-3f4d-4dc5-9036-8c14a1fa4fd7 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
3442025-01-16T20:00:03.302ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
3452025-01-16T20:00:03.302ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-16 19:49:07.686045 UTC dns_group = internal generation = 1
3462025-01-16T20:00:03.302ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 462.14461ms iteration = 13 status = {"generation":1}
3472025-01-16T20:00:03.302ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("token = \\"9fc7fee85a0620a9929e974a7fc00e15c0f6724d\\"") } result = Ok(())
3482025-01-16T20:00:03.302ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3492025-01-16T20:00:03.303ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3502025-01-16T20:00:03.304ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3512025-01-16T20:00:03.304ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3522025-01-16T20:00:03.306ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3532025-01-16T20:00:03.306ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3542025-01-16T20:00:03.308ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3552025-01-16T20:00:03.308ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3562025-01-16T20:00:03.309ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
3572025-01-16T20:00:03.310ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
3582025-01-16T20:00:03.311ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3592025-01-16T20:00:03.311ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3602025-01-16T20:00:03.312ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
3612025-01-16T20:00:03.313ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("9fc7fee85a0620a9929e974a7fc00e15c0f6724d") } result = Ok(())
3622025-01-16T20:00:03.313ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3632025-01-16T20:00:03.313ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3642025-01-16T20:00:03.318ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3652025-01-16T20:00:03.318ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3662025-01-16T20:00:03.320ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3672025-01-16T20:00:03.320ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3682025-01-16T20:00:03.321ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3692025-01-16T20:00:03.322ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3702025-01-16T20:00:03.323ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3712025-01-16T20:00:03.323ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3722025-01-16T20:00:03.325ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
3732025-01-16T20:00:03.326ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
3742025-01-16T20:00:03.326ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3752025-01-16T20:00:03.326ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3762025-01-16T20:00:03.328ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3772025-01-16T20:00:03.328ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3782025-01-16T20:00:03.329ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3792025-01-16T20:00:03.330ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3802025-01-16T20:00:03.331ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
3812025-01-16T20:00:03.331ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
3822025-01-16T20:00:03.332ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) } result = Ok(())
3832025-01-16T20:00:03.332ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
3842025-01-16T20:00:03.332ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
3852025-01-16T20:00:03.333ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 494.67966ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
3862025-01-16T20:00:03.333ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
3872025-01-16T20:00:03.334ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
3882025-01-16T20:00:03.334ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a72248fd-6945-4541-9705-d9c90bebd3f4", "date": "Thu, 16 Jan 2025 20:00:02 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
3892025-01-16T20:00:03.334ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
3902025-01-16T20:00:03.334ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
3912025-01-16T20:00:03.335ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
3922025-01-16T20:00:03.335ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
3932025-01-16T20:00:03.336ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6aa9e080-a82f-4923-8f33-2860960c55cf", "date": "Thu, 16 Jan 2025 20:00:03 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
3942025-01-16T20:00:03.336ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
3952025-01-16T20:00:03.337ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
3962025-01-16T20:00:03.338ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
3972025-01-16T20:00:03.338ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1c22f4e2-56f6-419a-8c16-818bb6b0ec4d", "date": "Thu, 16 Jan 2025 20:00:03 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
3982025-01-16T20:00:03.338ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
3992025-01-16T20:00:03.340ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {0b88d7a9-aac1-4818-9827-ddf6ae9f4566: {10.151.1.175: {9ce66cd4-bd29-4a83-9575-3dd321711509}, 10.151.1.176: {9ce66cd4-bd29-4a83-9575-3dd321711509}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
4002025-01-16T20:00:03.340ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
4012025-01-16T20:00:03.340ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "59f2200f-53dd-476a-b79e-7fff3c08aa10", "date": "Thu, 16 Jan 2025 20:00:02 GMT"} })
4022025-01-16T20:00:03.340ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4032025-01-16T20:00:03.340ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
4042025-01-16T20:00:03.340ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
4052025-01-16T20:00:03.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4062025-01-16T20:00:03.340ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
4072025-01-16T20:00:03.340ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 500.740016ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
4082025-01-16T20:00:03.342ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4092025-01-16T20:00:03.343ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
4102025-01-16T20:00:03.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4112025-01-16T20:00:03.343ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
4122025-01-16T20:00:03.345ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
4132025-01-16T20:00:03.345ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
4142025-01-16T20:00:03.346ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4152025-01-16T20:00:03.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4162025-01-16T20:00:03.348ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
4172025-01-16T20:00:03.349ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4182025-01-16T20:00:03.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4192025-01-16T20:00:03.350ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4202025-01-16T20:00:03.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4212025-01-16T20:00:03.353ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
4222025-01-16T20:00:03.353ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
4232025-01-16T20:00:03.353ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
4242025-01-16T20:00:03.353ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4252025-01-16T20:00:03.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4262025-01-16T20:00:03.355ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
4272025-01-16T20:00:03.355ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
4282025-01-16T20:00:03.355ZINFOnexus (BackgroundTasks): VPC route manager sled 87207105-a825-4eaa-ac6d-6aaa586b0fc5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
4292025-01-16T20:00:03.355ZINFOnexus (BackgroundTasks): VPC route manager sled 87207105-a825-4eaa-ac6d-6aaa586b0fc5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
4302025-01-16T20:00:03.355ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4312025-01-16T20:00:03.356ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d4f7e3e1-7870-4942-ae31-9b591b16eb4c", "date": "Thu, 16 Jan 2025 20:00:02 GMT"} })
4322025-01-16T20:00:03.357ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 520.148127ms iteration = 25 status = {}
4332025-01-16T20:00:03.358ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
4342025-01-16T20:00:03.358ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
4352025-01-16T20:00:03.360ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
4362025-01-16T20:00:03.360ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
4372025-01-16T20:00:03.362ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
4382025-01-16T20:00:03.363ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4392025-01-16T20:00:03.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4402025-01-16T20:00:03.365ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 6ec20bf0-03fa-4e36-9de7-54dd5e9cfde1, rack_id: 26dc04a7-8537-47d8-965d-0931849f651f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(438946af-d2bd-4eab-8036-57fe8293b9f9) } rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch_location = Switch0
4412025-01-16T20:00:03.365ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4422025-01-16T20:00:03.365ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
4432025-01-16T20:00:03.365ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
4442025-01-16T20:00:03.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4452025-01-16T20:00:03.365ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
4462025-01-16T20:00:03.368ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140099 local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 4f180849-64cc-421f-9988-789f6f2c7141 response_code = 200 uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
4472025-01-16T20:00:03.370ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4482025-01-16T20:00:03.370ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4492025-01-16T20:00:03.371ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4502025-01-16T20:00:03.371ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4512025-01-16T20:00:03.373ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4522025-01-16T20:00:03.374ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("token = \\"9fc7fee85a0620a9929e974a7fc00e15c0f6724d\\"") } result = Ok(())
4532025-01-16T20:00:03.374ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4542025-01-16T20:00:03.374ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4552025-01-16T20:00:03.375ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4562025-01-16T20:00:03.375ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "150d5c31-f2c2-4b1f-a135-abc5d540e90c", "content-length": "134", "date": "Thu, 16 Jan 2025 20:00:02 GMT"} })
4572025-01-16T20:00:03.375ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
4582025-01-16T20:00:03.375ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 438946af-d2bd-4eab-8036-57fe8293b9f9
4592025-01-16T20:00:03.375ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4602025-01-16T20:00:03.376ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
4612025-01-16T20:00:03.376ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
4622025-01-16T20:00:03.376ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4632025-01-16T20:00:03.376ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4642025-01-16T20:00:03.376ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4652025-01-16T20:00:03.376ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4662025-01-16T20:00:03.376ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4672025-01-16T20:00:03.376ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4682025-01-16T20:00:03.376ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4692025-01-16T20:00:03.376ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f
4702025-01-16T20:00:03.376ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4712025-01-16T20:00:03.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4722025-01-16T20:00:03.377ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4732025-01-16T20:00:03.377ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4742025-01-16T20:00:03.378ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
4752025-01-16T20:00:03.378ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "41fd47e0-400b-46b2-b210-13ecfc31dae7", "content-length": "2", "date": "Thu, 16 Jan 2025 20:00:02 GMT"} })
4762025-01-16T20:00:03.378ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
4772025-01-16T20:00:03.378ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "73ba5c6e-5221-42bd-9942-1a1f126f0788", "content-length": "52", "date": "Thu, 16 Jan 2025 20:00:02 GMT"} })
4782025-01-16T20:00:03.378ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch_location = Switch0
4792025-01-16T20:00:03.378ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
4802025-01-16T20:00:03.378ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4812025-01-16T20:00:03.378ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4822025-01-16T20:00:03.380ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4832025-01-16T20:00:03.381ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
4842025-01-16T20:00:03.381ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4852025-01-16T20:00:03.381ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4862025-01-16T20:00:03.383ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4872025-01-16T20:00:03.384ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("9fc7fee85a0620a9929e974a7fc00e15c0f6724d") } result = Ok(())
4882025-01-16T20:00:03.384ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4892025-01-16T20:00:03.384ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4902025-01-16T20:00:03.389ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4912025-01-16T20:00:03.389ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4922025-01-16T20:00:03.390ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4932025-01-16T20:00:03.390ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4942025-01-16T20:00:03.392ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4952025-01-16T20:00:03.392ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4962025-01-16T20:00:03.393ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4972025-01-16T20:00:03.394ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4982025-01-16T20:00:03.395ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4992025-01-16T20:00:03.396ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
5002025-01-16T20:00:03.396ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5012025-01-16T20:00:03.396ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5022025-01-16T20:00:03.398ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5032025-01-16T20:00:03.398ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5042025-01-16T20:00:03.399ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5052025-01-16T20:00:03.400ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5062025-01-16T20:00:03.401ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
5072025-01-16T20:00:03.401ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) } result = Ok(())
5082025-01-16T20:00:03.401ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5092025-01-16T20:00:03.402ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5102025-01-16T20:00:03.403ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5112025-01-16T20:00:03.403ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5122025-01-16T20:00:03.404ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5132025-01-16T20:00:03.404ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5142025-01-16T20:00:03.406ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5152025-01-16T20:00:03.407ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5162025-01-16T20:00:03.409ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5172025-01-16T20:00:03.409ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5182025-01-16T20:00:03.411ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5192025-01-16T20:00:03.411ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5202025-01-16T20:00:03.413ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5212025-01-16T20:00:03.413ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5222025-01-16T20:00:03.416ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5232025-01-16T20:00:03.418ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5242025-01-16T20:00:03.418ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5252025-01-16T20:00:03.419ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5262025-01-16T20:00:03.421ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5272025-01-16T20:00:03.421ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5282025-01-16T20:00:03.423ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5292025-01-16T20:00:03.424ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5302025-01-16T20:00:03.425ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5312025-01-16T20:00:03.425ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5322025-01-16T20:00:03.428ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5332025-01-16T20:00:03.430ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5342025-01-16T20:00:03.430ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5352025-01-16T20:00:03.431ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5362025-01-16T20:00:03.469ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99065 local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = a9daf53c-a9d0-475b-9ef0-1b1c7ce88841 response_code = 200 uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
5372025-01-16T20:00:03.479ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "358c5f65-9124-46a6-a576-833206e53fed", "date": "Thu, 16 Jan 2025 20:00:02 GMT"} })
5382025-01-16T20:00:03.479ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch = Switch0
5392025-01-16T20:00:03.479ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
5402025-01-16T20:00:03.480ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2a340f1-af42-4747-8541-a8d980a92847", "content-length": "682", "date": "Thu, 16 Jan 2025 20:00:02 GMT"} })
5412025-01-16T20:00:03.480ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5422025-01-16T20:00:03.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5432025-01-16T20:00:03.483ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5442025-01-16T20:00:03.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5452025-01-16T20:00:03.487ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5462025-01-16T20:00:03.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5472025-01-16T20:00:03.490ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5482025-01-16T20:00:03.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5492025-01-16T20:00:03.497ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 657.012539ms iteration = 23 status = {}
5502025-01-16T20:00:08.895ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5512025-01-16T20:00:08.895ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5522025-01-16T20:00:08.896ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5532025-01-16T20:00:08.896ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5542025-01-16T20:00:08.898ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
5552025-01-16T20:00:08.899ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("token = \\"9fc7fee85a0620a9929e974a7fc00e15c0f6724d\\"") } result = Ok(())
5562025-01-16T20:00:08.899ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5572025-01-16T20:00:08.900ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5582025-01-16T20:00:08.901ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5592025-01-16T20:00:08.902ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5602025-01-16T20:00:08.903ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5612025-01-16T20:00:08.903ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5622025-01-16T20:00:08.905ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5632025-01-16T20:00:08.905ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5642025-01-16T20:00:08.907ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
5652025-01-16T20:00:08.908ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
5662025-01-16T20:00:08.908ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5672025-01-16T20:00:08.908ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5682025-01-16T20:00:08.910ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
5692025-01-16T20:00:08.911ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("9fc7fee85a0620a9929e974a7fc00e15c0f6724d") } result = Ok(())
5702025-01-16T20:00:08.911ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5712025-01-16T20:00:08.911ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5722025-01-16T20:00:08.916ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5732025-01-16T20:00:08.916ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5742025-01-16T20:00:08.918ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5752025-01-16T20:00:08.918ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5762025-01-16T20:00:08.919ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5772025-01-16T20:00:08.920ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5782025-01-16T20:00:08.921ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5792025-01-16T20:00:08.921ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5802025-01-16T20:00:08.923ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
5812025-01-16T20:00:08.924ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
5822025-01-16T20:00:08.924ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5832025-01-16T20:00:08.924ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5842025-01-16T20:00:08.926ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5852025-01-16T20:00:08.926ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5862025-01-16T20:00:08.927ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5872025-01-16T20:00:08.927ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5882025-01-16T20:00:08.929ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
5892025-01-16T20:00:08.930ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) } result = Ok(())
5902025-01-16T20:00:08.930ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
5912025-01-16T20:00:08.930ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
5922025-01-16T20:00:08.931ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
5932025-01-16T20:00:08.931ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
5942025-01-16T20:00:08.933ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
5952025-01-16T20:00:08.934ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
5962025-01-16T20:00:08.936ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
5972025-01-16T20:00:08.937ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
5982025-01-16T20:00:08.938ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
5992025-01-16T20:00:08.939ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
6002025-01-16T20:00:08.941ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
6012025-01-16T20:00:08.941ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
6022025-01-16T20:00:08.944ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
6032025-01-16T20:00:08.944ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
6042025-01-16T20:00:08.946ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
6052025-01-16T20:00:08.949ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
6062025-01-16T20:00:08.949ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
6072025-01-16T20:00:08.949ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
6082025-01-16T20:00:08.952ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
6092025-01-16T20:00:08.952ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
6102025-01-16T20:00:08.954ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
6112025-01-16T20:00:08.954ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
6122025-01-16T20:00:08.956ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
6132025-01-16T20:00:08.957ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
6142025-01-16T20:00:08.959ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
6152025-01-16T20:00:08.961ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
6162025-01-16T20:00:08.962ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
6172025-01-16T20:00:08.962ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
6182025-01-16T20:00:08.964ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69588 local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 1e3f8d20-2bcb-4402-bc67-a04d201e3237 response_code = 200 uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
6192025-01-16T20:00:08.965ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6202025-01-16T20:00:08.965ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6212025-01-16T20:00:08.967ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6222025-01-16T20:00:08.967ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6232025-01-16T20:00:08.968ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6242025-01-16T20:00:08.969ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("token = \\"9fc7fee85a0620a9929e974a7fc00e15c0f6724d\\"") } result = Ok(())
6252025-01-16T20:00:08.969ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6262025-01-16T20:00:08.969ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6272025-01-16T20:00:08.970ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6282025-01-16T20:00:08.971ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6292025-01-16T20:00:08.972ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6302025-01-16T20:00:08.972ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6312025-01-16T20:00:08.973ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6322025-01-16T20:00:08.973ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6332025-01-16T20:00:08.975ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6342025-01-16T20:00:08.976ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
6352025-01-16T20:00:08.976ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6362025-01-16T20:00:08.976ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6372025-01-16T20:00:08.977ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6382025-01-16T20:00:08.978ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("9fc7fee85a0620a9929e974a7fc00e15c0f6724d") } result = Ok(())
6392025-01-16T20:00:08.978ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6402025-01-16T20:00:08.978ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6412025-01-16T20:00:08.981ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6422025-01-16T20:00:08.981ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6432025-01-16T20:00:08.983ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6442025-01-16T20:00:08.983ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6452025-01-16T20:00:08.984ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6462025-01-16T20:00:08.984ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6472025-01-16T20:00:08.986ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6482025-01-16T20:00:08.986ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6492025-01-16T20:00:08.987ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6502025-01-16T20:00:08.988ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
6512025-01-16T20:00:08.988ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6522025-01-16T20:00:08.988ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6532025-01-16T20:00:08.989ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6542025-01-16T20:00:08.990ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6552025-01-16T20:00:08.991ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6562025-01-16T20:00:08.991ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6572025-01-16T20:00:08.992ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6582025-01-16T20:00:08.993ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) } result = Ok(())
6592025-01-16T20:00:08.993ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6602025-01-16T20:00:08.993ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6612025-01-16T20:00:08.995ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6622025-01-16T20:00:08.995ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6632025-01-16T20:00:08.997ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6642025-01-16T20:00:08.997ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6652025-01-16T20:00:08.999ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6662025-01-16T20:00:08.999ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6672025-01-16T20:00:09.001ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6682025-01-16T20:00:09.001ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6692025-01-16T20:00:09.003ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6702025-01-16T20:00:09.003ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6712025-01-16T20:00:09.006ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6722025-01-16T20:00:09.006ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6732025-01-16T20:00:09.008ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6742025-01-16T20:00:09.010ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6752025-01-16T20:00:09.010ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6762025-01-16T20:00:09.011ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6772025-01-16T20:00:09.013ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6782025-01-16T20:00:09.014ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6792025-01-16T20:00:09.016ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6802025-01-16T20:00:09.016ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6812025-01-16T20:00:09.019ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6822025-01-16T20:00:09.019ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6832025-01-16T20:00:09.022ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6842025-01-16T20:00:09.025ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6852025-01-16T20:00:09.025ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6862025-01-16T20:00:09.025ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6872025-01-16T20:00:09.063ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97613 local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 55ecf1c2-1256-43cb-a76e-19c2fb47d0d0 response_code = 200 uri = /v1/instances/instance-15e37f20fef/serial-console?from_start=0&max_bytes=10485760&project=proj-1279a041a9e
6882025-01-16T20:00:09.737ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6892025-01-16T20:00:09.738ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6902025-01-16T20:00:09.739ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6912025-01-16T20:00:09.739ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6922025-01-16T20:00:09.741ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6932025-01-16T20:00:09.743ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("token = \\"9fc7fee85a0620a9929e974a7fc00e15c0f6724d\\"") } result = Ok(())
6942025-01-16T20:00:09.743ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6952025-01-16T20:00:09.743ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6962025-01-16T20:00:09.745ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6972025-01-16T20:00:09.745ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6982025-01-16T20:00:09.747ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6992025-01-16T20:00:09.747ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7002025-01-16T20:00:09.748ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7012025-01-16T20:00:09.748ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7022025-01-16T20:00:09.750ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7032025-01-16T20:00:09.751ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
7042025-01-16T20:00:09.751ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7052025-01-16T20:00:09.751ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7062025-01-16T20:00:09.753ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7072025-01-16T20:00:09.754ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("9fc7fee85a0620a9929e974a7fc00e15c0f6724d") } result = Ok(())
7082025-01-16T20:00:09.754ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7092025-01-16T20:00:09.754ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7102025-01-16T20:00:09.759ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7112025-01-16T20:00:09.759ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7122025-01-16T20:00:09.761ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7132025-01-16T20:00:09.761ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7142025-01-16T20:00:09.763ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7152025-01-16T20:00:09.763ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7162025-01-16T20:00:09.765ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7172025-01-16T20:00:09.765ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7182025-01-16T20:00:09.766ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7192025-01-16T20:00:09.768ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
7202025-01-16T20:00:09.768ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7212025-01-16T20:00:09.768ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7222025-01-16T20:00:09.769ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7232025-01-16T20:00:09.769ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7242025-01-16T20:00:09.771ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7252025-01-16T20:00:09.771ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7262025-01-16T20:00:09.772ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7272025-01-16T20:00:09.773ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) } result = Ok(())
7282025-01-16T20:00:09.773ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7292025-01-16T20:00:09.773ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7302025-01-16T20:00:09.775ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7312025-01-16T20:00:09.775ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7322025-01-16T20:00:09.776ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7332025-01-16T20:00:09.777ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7342025-01-16T20:00:09.778ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7352025-01-16T20:00:09.779ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7362025-01-16T20:00:09.781ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7372025-01-16T20:00:09.781ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7382025-01-16T20:00:09.783ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7392025-01-16T20:00:09.783ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7402025-01-16T20:00:09.786ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7412025-01-16T20:00:09.786ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7422025-01-16T20:00:09.789ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7432025-01-16T20:00:09.791ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7442025-01-16T20:00:09.791ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7452025-01-16T20:00:09.792ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7462025-01-16T20:00:09.794ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7472025-01-16T20:00:09.794ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7482025-01-16T20:00:09.797ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7492025-01-16T20:00:09.797ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7502025-01-16T20:00:09.799ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7512025-01-16T20:00:09.799ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7522025-01-16T20:00:09.802ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7532025-01-16T20:00:09.804ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7542025-01-16T20:00:09.804ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7552025-01-16T20:00:09.805ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7562025-01-16T20:00:09.807ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69502 local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = b8938cc8-41c7-4b02-bb8e-47dc0f83defe response_code = 200 uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
7572025-01-16T20:00:09.808ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7582025-01-16T20:00:09.808ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7592025-01-16T20:00:09.810ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7602025-01-16T20:00:09.810ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7612025-01-16T20:00:09.811ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7622025-01-16T20:00:09.812ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("token = \\"9fc7fee85a0620a9929e974a7fc00e15c0f6724d\\"") } result = Ok(())
7632025-01-16T20:00:09.812ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7642025-01-16T20:00:09.812ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7652025-01-16T20:00:09.814ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7662025-01-16T20:00:09.814ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7672025-01-16T20:00:09.815ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7682025-01-16T20:00:09.815ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7692025-01-16T20:00:09.817ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7702025-01-16T20:00:09.817ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7712025-01-16T20:00:09.818ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7722025-01-16T20:00:09.819ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
7732025-01-16T20:00:09.819ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7742025-01-16T20:00:09.819ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7752025-01-16T20:00:09.821ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7762025-01-16T20:00:09.822ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("9fc7fee85a0620a9929e974a7fc00e15c0f6724d") } result = Ok(())
7772025-01-16T20:00:09.822ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7782025-01-16T20:00:09.822ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7792025-01-16T20:00:09.826ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7802025-01-16T20:00:09.826ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7812025-01-16T20:00:09.827ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7822025-01-16T20:00:09.827ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7832025-01-16T20:00:09.828ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7842025-01-16T20:00:09.829ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7852025-01-16T20:00:09.830ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7862025-01-16T20:00:09.830ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7872025-01-16T20:00:09.831ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7882025-01-16T20:00:09.832ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
7892025-01-16T20:00:09.832ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7902025-01-16T20:00:09.832ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7912025-01-16T20:00:09.833ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7922025-01-16T20:00:09.834ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7932025-01-16T20:00:09.835ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7942025-01-16T20:00:09.835ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7952025-01-16T20:00:09.836ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7962025-01-16T20:00:09.837ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) } result = Ok(())
7972025-01-16T20:00:09.837ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
7982025-01-16T20:00:09.837ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
7992025-01-16T20:00:09.839ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8002025-01-16T20:00:09.839ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8012025-01-16T20:00:09.840ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8022025-01-16T20:00:09.841ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8032025-01-16T20:00:09.843ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8042025-01-16T20:00:09.843ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8052025-01-16T20:00:09.846ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8062025-01-16T20:00:09.846ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8072025-01-16T20:00:09.848ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8082025-01-16T20:00:09.848ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8092025-01-16T20:00:09.850ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8102025-01-16T20:00:09.851ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8112025-01-16T20:00:09.853ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8122025-01-16T20:00:09.856ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8132025-01-16T20:00:09.856ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8142025-01-16T20:00:09.856ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8152025-01-16T20:00:09.858ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8162025-01-16T20:00:09.858ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8172025-01-16T20:00:09.861ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8182025-01-16T20:00:09.861ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8192025-01-16T20:00:09.863ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8202025-01-16T20:00:09.863ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8212025-01-16T20:00:09.865ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8222025-01-16T20:00:09.868ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8232025-01-16T20:00:09.868ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8242025-01-16T20:00:09.868ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8252025-01-16T20:00:09.906ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97641 local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:49716 req_id = 13437d42-070a-4d54-a97e-1607ec9a707c response_code = 200 uri = /v1/instances/instance-15e37f20fef/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-1279a041a9e
8262025-01-16T20:00:10.392ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8272025-01-16T20:00:10.392ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8282025-01-16T20:00:10.394ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8292025-01-16T20:00:10.394ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8302025-01-16T20:00:10.396ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
8312025-01-16T20:00:10.397ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("token = \\"9fc7fee85a0620a9929e974a7fc00e15c0f6724d\\"") } result = Ok(())
8322025-01-16T20:00:10.397ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8332025-01-16T20:00:10.397ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8342025-01-16T20:00:10.399ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8352025-01-16T20:00:10.399ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8362025-01-16T20:00:10.401ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8372025-01-16T20:00:10.401ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8382025-01-16T20:00:10.402ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8392025-01-16T20:00:10.403ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8402025-01-16T20:00:10.404ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
8412025-01-16T20:00:10.405ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
8422025-01-16T20:00:10.405ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8432025-01-16T20:00:10.405ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8442025-01-16T20:00:10.406ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
8452025-01-16T20:00:10.407ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("9fc7fee85a0620a9929e974a7fc00e15c0f6724d") } result = Ok(())
8462025-01-16T20:00:10.407ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8472025-01-16T20:00:10.408ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8482025-01-16T20:00:10.413ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8492025-01-16T20:00:10.413ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8502025-01-16T20:00:10.414ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8512025-01-16T20:00:10.414ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8522025-01-16T20:00:10.416ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8532025-01-16T20:00:10.416ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8542025-01-16T20:00:10.417ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8552025-01-16T20:00:10.418ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8562025-01-16T20:00:10.421ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
8572025-01-16T20:00:10.422ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
8582025-01-16T20:00:10.422ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8592025-01-16T20:00:10.422ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8602025-01-16T20:00:10.424ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8612025-01-16T20:00:10.424ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8622025-01-16T20:00:10.426ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8632025-01-16T20:00:10.426ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8642025-01-16T20:00:10.428ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
8652025-01-16T20:00:10.429ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) } result = Ok(())
8662025-01-16T20:00:10.429ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8672025-01-16T20:00:10.429ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8682025-01-16T20:00:10.430ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8692025-01-16T20:00:10.430ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8702025-01-16T20:00:10.432ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8712025-01-16T20:00:10.432ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8722025-01-16T20:00:10.435ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8732025-01-16T20:00:10.435ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8742025-01-16T20:00:10.437ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8752025-01-16T20:00:10.438ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8762025-01-16T20:00:10.440ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8772025-01-16T20:00:10.440ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8782025-01-16T20:00:10.442ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8792025-01-16T20:00:10.443ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8802025-01-16T20:00:10.445ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8812025-01-16T20:00:10.448ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8822025-01-16T20:00:10.448ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8832025-01-16T20:00:10.448ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8842025-01-16T20:00:10.451ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8852025-01-16T20:00:10.451ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8862025-01-16T20:00:10.453ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8872025-01-16T20:00:10.454ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8882025-01-16T20:00:10.456ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8892025-01-16T20:00:10.456ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8902025-01-16T20:00:10.458ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8912025-01-16T20:00:10.461ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8922025-01-16T20:00:10.461ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8932025-01-16T20:00:10.461ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
8942025-01-16T20:00:10.463ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
8952025-01-16T20:00:10.464ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
8962025-01-16T20:00:10.469ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
8972025-01-16T20:00:10.470ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
8982025-01-16T20:00:10.471ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
8992025-01-16T20:00:10.473ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Sled { parent: Fleet, key: 87207105-a825-4eaa-ac6d-6aaa586b0fc5, lookup_type: ById(87207105-a825-4eaa-ac6d-6aaa586b0fc5) } result = Ok(())
9002025-01-16T20:00:10.503ZDEBGnexus: client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vmms/92a6af21-e052-40a2-a996-c243f3f872d8/state
9012025-01-16T20:00:10.506ZDEBGnexus: client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/92a6af21-e052-40a2-a996-c243f3f872d8/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "89fb9cfe-abdc-4798-b2bc-e3a107d825f8", "content-length": "151", "date": "Thu, 16 Jan 2025 20:00:10 GMT"} })
9022025-01-16T20:00:10.506ZINFOnexus (dropshot_external): received new VMM runtime state from sled agent actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = 172.30.2.7:443 method = POST migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 92a6af21-e052-40a2-a996-c243f3f872d8 remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2025-01-16T20:00:10.506624712Z }
9032025-01-16T20:00:10.506ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
9042025-01-16T20:00:10.507ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
9052025-01-16T20:00:10.523ZWARNnexus (datastore): Retryable transaction failure file = nexus/db-queries/src/transaction_retry.rs:165 retry_after (ms) = 16 transaction = vmm_and_migration_update_runtime
9062025-01-16T20:00:10.549ZINFOnexus (datastore): transaction completed attempts = 2 file = nexus/db-queries/src/transaction_retry.rs:121 transaction = vmm_and_migration_update_runtime
9072025-01-16T20:00:10.551ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
9082025-01-16T20:00:10.552ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
9092025-01-16T20:00:10.554ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
9102025-01-16T20:00:10.554ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
9112025-01-16T20:00:10.557ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
9122025-01-16T20:00:10.557ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
9132025-01-16T20:00:10.560ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
9142025-01-16T20:00:10.560ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
9152025-01-16T20:00:10.563ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
9162025-01-16T20:00:10.566ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
9172025-01-16T20:00:10.566ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
9182025-01-16T20:00:10.566ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
9192025-01-16T20:00:10.568ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179224 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:49716 req_id = 70a88fcb-408f-450d-85a5-e5548bdf1ae8 response_code = 202 uri = /v1/instances/instance-15e37f20fef/stop?project=proj-1279a041a9e
9202025-01-16T20:00:10.570ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9212025-01-16T20:00:10.570ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9222025-01-16T20:00:10.571ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9232025-01-16T20:00:10.572ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9242025-01-16T20:00:10.573ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
9252025-01-16T20:00:10.575ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("token = \\"9fc7fee85a0620a9929e974a7fc00e15c0f6724d\\"") } result = Ok(())
9262025-01-16T20:00:10.575ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9272025-01-16T20:00:10.575ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9282025-01-16T20:00:10.576ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9292025-01-16T20:00:10.576ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9302025-01-16T20:00:10.578ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9312025-01-16T20:00:10.578ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9322025-01-16T20:00:10.580ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9332025-01-16T20:00:10.580ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9342025-01-16T20:00:10.585ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
9352025-01-16T20:00:10.587ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
9362025-01-16T20:00:10.587ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9372025-01-16T20:00:10.587ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9382025-01-16T20:00:10.589ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
9392025-01-16T20:00:10.590ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("9fc7fee85a0620a9929e974a7fc00e15c0f6724d") } result = Ok(())
9402025-01-16T20:00:10.590ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9412025-01-16T20:00:10.590ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9422025-01-16T20:00:10.604ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9432025-01-16T20:00:10.605ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9442025-01-16T20:00:10.606ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9452025-01-16T20:00:10.606ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9462025-01-16T20:00:10.608ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9472025-01-16T20:00:10.608ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9482025-01-16T20:00:10.609ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9492025-01-16T20:00:10.609ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9502025-01-16T20:00:10.611ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
9512025-01-16T20:00:10.612ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
9522025-01-16T20:00:10.612ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9532025-01-16T20:00:10.612ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9542025-01-16T20:00:10.613ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9552025-01-16T20:00:10.613ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9562025-01-16T20:00:10.615ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9572025-01-16T20:00:10.615ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9582025-01-16T20:00:10.617ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
9592025-01-16T20:00:10.618ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) } result = Ok(())
9602025-01-16T20:00:10.618ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = fe1ecd78-2ada-4470-a700-8afd5fcb99cd roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
9612025-01-16T20:00:10.618ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = fe1ecd78-2ada-4470-a700-8afd5fcb99cd resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
9622025-01-16T20:00:10.619ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = fe1ecd78-2ada-4470-a700-8afd5fcb99cd roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
9632025-01-16T20:00:10.620ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = fe1ecd78-2ada-4470-a700-8afd5fcb99cd resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
9642025-01-16T20:00:10.621ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = fe1ecd78-2ada-4470-a700-8afd5fcb99cd roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
9652025-01-16T20:00:10.622ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = fe1ecd78-2ada-4470-a700-8afd5fcb99cd resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
9662025-01-16T20:00:10.623ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = fe1ecd78-2ada-4470-a700-8afd5fcb99cd roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
9672025-01-16T20:00:10.623ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = fe1ecd78-2ada-4470-a700-8afd5fcb99cd resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
9682025-01-16T20:00:10.626ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = fe1ecd78-2ada-4470-a700-8afd5fcb99cd roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
9692025-01-16T20:00:10.626ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = fe1ecd78-2ada-4470-a700-8afd5fcb99cd resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
9702025-01-16T20:00:10.628ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = fe1ecd78-2ada-4470-a700-8afd5fcb99cd roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
9712025-01-16T20:00:10.629ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = fe1ecd78-2ada-4470-a700-8afd5fcb99cd resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
9722025-01-16T20:00:10.631ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = fe1ecd78-2ada-4470-a700-8afd5fcb99cd roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
9732025-01-16T20:00:10.631ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = fe1ecd78-2ada-4470-a700-8afd5fcb99cd resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
9742025-01-16T20:00:10.633ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = fe1ecd78-2ada-4470-a700-8afd5fcb99cd roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
9752025-01-16T20:00:10.636ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = fe1ecd78-2ada-4470-a700-8afd5fcb99cd resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
9762025-01-16T20:00:10.636ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
9772025-01-16T20:00:10.636ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
9782025-01-16T20:00:10.638ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
9792025-01-16T20:00:10.639ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
9802025-01-16T20:00:10.639ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
9812025-01-16T20:00:10.639ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
9822025-01-16T20:00:10.643ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete
9832025-01-16T20:00:10.643ZINFOnexus (SEC): saga create dag = {"end_node":5,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,0,null],[3,5,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_delete.instance_delete_nat","label":"InstanceDeleteNat","name":"no_result4"}},{"Action":{"action_name":"instance_delete.instance_delete_record","label":"InstanceDeleteRecord","name":"no_result1"}},{"Action":{"action_name":"instance_delete.delete_network_interfaces","label":"DeleteNetworkInterfaces","name":"no_result2"}},{"Action":{"action_name":"instance_delete.deallocate_external_ip","label":"DeallocateExternalIp","name":"no_result3"}},{"Start":{"params":{"authz_instance":{"key":"3de40729-f38e-405c-b30f-63d86ff0cdd0","lookup_type":{"ByName":"instance-15e37f20fef"},"parent":{"key":"3b7a3701-30a8-4657-a953-08ef3b6f1b29","lookup_type":{"ByName":"proj-1279a041a9e"},"parent":{"key":"197fa9bd-2b54-417a-8249-a5354e078485","lookup_type":{"ById":"197fa9bd-2b54-417a-8249-a5354e078485"},"parent":null}}},"boundary_switches":["switch0"],"instance":{"auto_restart":{"cooldown":null,"policy":null},"boot_disk_id":"ada4fced-de0a-4ecb-950f-3d3298809a3a","hostname":"localshark","identity":{"description":"","id":"3de40729-f38e-405c-b30f-63d86ff0cdd0","name":"instance-15e37f20fef","time_created":"2025-01-16T19:59:49.868141Z","time_deleted":null,"time_modified":"2025-01-16T19:59:49.868141Z"},"memory":1073741824,"ncpus":2,"project_id":"3b7a3701-30a8-4657-a953-08ef3b6f1b29","runtime_state":{"dst_propolis_id":null,"gen":3,"migration_id":null,"nexus_state":"Vmm","propolis_id":"92a6af21-e052-40a2-a996-c243f3f872d8","time_last_auto_restarted":null,"time_updated":"2025-01-16T19:59:49.868141Z"},"updater_gen":1,"updater_id":null,"user_data":[]},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"197fa9bd-2b54-417a-8249-a5354e078485","silo_user_id":"7dece980-441d-4848-943d-fffce58ad417"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"instance-delete","start_node":4} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
9842025-01-16T20:00:10.643ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete
9852025-01-16T20:00:10.649ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete
9862025-01-16T20:00:10.649ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
9872025-01-16T20:00:10.649ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
9882025-01-16T20:00:10.649ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63
9892025-01-16T20:00:10.656ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
9902025-01-16T20:00:10.656ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63
9912025-01-16T20:00:10.660ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
9922025-01-16T20:00:10.660ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63
9932025-01-16T20:00:10.666ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteNat
9942025-01-16T20:00:10.666ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteNat
9952025-01-16T20:00:10.668ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteNat
9962025-01-16T20:00:10.669ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteNat
9972025-01-16T20:00:10.670ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteNat
9982025-01-16T20:00:10.670ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteNat
9992025-01-16T20:00:10.672ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteNat
10002025-01-16T20:00:10.672ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteNat
10012025-01-16T20:00:10.674ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteNat
10022025-01-16T20:00:10.675ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteNat
10032025-01-16T20:00:10.677ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteNat
10042025-01-16T20:00:10.677ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteNat
10052025-01-16T20:00:10.680ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteNat
10062025-01-16T20:00:10.680ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteNat
10072025-01-16T20:00:10.683ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteNat
10082025-01-16T20:00:10.686ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ById(3b7a3701-30a8-4657-a953-08ef3b6f1b29) }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ById(3de40729-f38e-405c-b30f-63d86ff0cdd0) } result = Ok(()) saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteNat
10092025-01-16T20:00:10.686ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 3de40729-f38e-405c-b30f-63d86ff0cdd0
10102025-01-16T20:00:10.686ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteNat
10112025-01-16T20:00:10.686ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteNat
10122025-01-16T20:00:10.689ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteNat
10132025-01-16T20:00:10.690ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteNat
10142025-01-16T20:00:10.711ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteNat
10152025-01-16T20:00:10.712ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteNat
10162025-01-16T20:00:10.728ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
10172025-01-16T20:00:10.728ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
10182025-01-16T20:00:10.730ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
10192025-01-16T20:00:10.731ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
10202025-01-16T20:00:10.731ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
10212025-01-16T20:00:10.731ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
10222025-01-16T20:00:10.737ZDEBGnexus: notifying dendrite of updates instance_id = Some(3de40729-f38e-405c-b30f-63d86ff0cdd0 (instance)) switch = switch0
10232025-01-16T20:00:10.738ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1568, tv_nsec: 971189031 } })
10242025-01-16T20:00:10.738ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1104
10252025-01-16T20:00:10.772ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
10262025-01-16T20:00:10.772ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10272025-01-16T20:00:10.772ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "461944fe-0c10-4e5b-a619-61200932bc58", "content-length": "26", "date": "Thu, 16 Jan 2025 20:00:10 GMT"} })
10282025-01-16T20:00:10.772ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10292025-01-16T20:00:10.773ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10302025-01-16T20:00:10.802ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
10312025-01-16T20:00:10.802ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "14685a88-f03f-4f5a-a2c8-7c88a7625cb2", "content-length": "4", "date": "Thu, 16 Jan 2025 20:00:09 GMT"} })
10322025-01-16T20:00:10.804ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
10332025-01-16T20:00:10.804ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 0 saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63
10342025-01-16T20:00:10.810ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
10352025-01-16T20:00:10.810ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63
10362025-01-16T20:00:10.814ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteRecord
10372025-01-16T20:00:10.815ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteRecord
10382025-01-16T20:00:10.820ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteRecord
10392025-01-16T20:00:10.820ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteRecord
10402025-01-16T20:00:10.823ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteRecord
10412025-01-16T20:00:10.823ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteRecord
10422025-01-16T20:00:10.826ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteRecord
10432025-01-16T20:00:10.826ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteRecord
10442025-01-16T20:00:10.828ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteRecord
10452025-01-16T20:00:10.831ZDEBGnexus (SagaExecutor): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteRecord
10462025-01-16T20:00:10.831ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteRecord
10472025-01-16T20:00:10.831ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_node = InstanceDeleteRecord
10482025-01-16T20:00:10.849ZDEBGnexus (SEC): saga log event new_state = N001 failed sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
10492025-01-16T20:00:10.849ZDEBGnexus (SecStore): recording saga event event_type = Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }) node_id = 1 saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63
10502025-01-16T20:00:10.853ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Unwinding saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
10512025-01-16T20:00:10.853ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = unwinding saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63
10522025-01-16T20:00:10.892ZDEBGnexus (SEC): saga log event new_state = N000 undo_started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
10532025-01-16T20:00:10.892ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 0 saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63
10542025-01-16T20:00:10.896ZDEBGnexus (SEC): saga log event new_state = N000 undo_finished sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
10552025-01-16T20:00:10.897ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 0 saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63
10562025-01-16T20:00:10.901ZDEBGnexus (SEC): saga log event new_state = N004 undo_started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
10572025-01-16T20:00:10.901ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 4 saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63
10582025-01-16T20:00:10.905ZDEBGnexus (SEC): saga log event new_state = N004 undo_finished sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
10592025-01-16T20:00:10.905ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 4 saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63
10602025-01-16T20:00:10.910ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
10612025-01-16T20:00:10.910ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63
10622025-01-16T20:00:10.918ZWARNnexus (SEC): saga finished action_error_node_name = "no_result1" action_error_source = ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} } file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1044 result = failure saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57 undo_result = success
10632025-01-16T20:00:10.918ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 2afb0cc9-0871-4c37-8666-1dac2baa1f63 saga_name = instance-delete saga_result = SagaResult { saga_id: 2afb0cc9-0871-4c37-8666-1dac2baa1f63, saga_log: SagaLog { saga_id: 2afb0cc9-0871-4c37-8666-1dac2baa1f63, unwinding: true, events: [N004 started, N004 succeeded, N000 started, N000 succeeded, N001 started, N001 failed, N000 undo_started, N000 undo_finished, N004 undo_started, N004 undo_finished], node_status: {0: UndoFinished, 1: Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }), 4: UndoFinished} }, kind: Err(SagaResultErr { error_node_name: "no_result1", error_source: ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }, undo_failure: None }) }
10642025-01-16T20:00:10.918ZINFOnexus (dropshot_external): request completed error_message_external = cannot delete instance: instance is running or has not yet fully stopped error_message_internal = cannot delete instance: instance is running or has not yet fully stopped (with internal context: saga ACTION error at node "no_result1") file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 348641 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = fe1ecd78-2ada-4470-a700-8afd5fcb99cd response_code = 400 uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
10652025-01-16T20:00:11.921ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10662025-01-16T20:00:11.922ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10672025-01-16T20:00:11.923ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10682025-01-16T20:00:11.923ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10692025-01-16T20:00:11.925ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10702025-01-16T20:00:11.926ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("token = \\"9fc7fee85a0620a9929e974a7fc00e15c0f6724d\\"") } result = Ok(())
10712025-01-16T20:00:11.926ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10722025-01-16T20:00:11.926ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10732025-01-16T20:00:11.928ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10742025-01-16T20:00:11.928ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10752025-01-16T20:00:11.930ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10762025-01-16T20:00:11.930ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10772025-01-16T20:00:11.932ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10782025-01-16T20:00:11.932ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10792025-01-16T20:00:11.934ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10802025-01-16T20:00:11.935ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
10812025-01-16T20:00:11.935ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10822025-01-16T20:00:11.935ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10832025-01-16T20:00:11.937ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10842025-01-16T20:00:11.938ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("9fc7fee85a0620a9929e974a7fc00e15c0f6724d") } result = Ok(())
10852025-01-16T20:00:11.938ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10862025-01-16T20:00:11.938ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10872025-01-16T20:00:11.944ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10882025-01-16T20:00:11.945ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10892025-01-16T20:00:11.946ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10902025-01-16T20:00:11.947ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10912025-01-16T20:00:11.948ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10922025-01-16T20:00:11.948ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10932025-01-16T20:00:11.950ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10942025-01-16T20:00:11.950ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10952025-01-16T20:00:11.951ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10962025-01-16T20:00:11.952ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
10972025-01-16T20:00:11.952ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10982025-01-16T20:00:11.952ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10992025-01-16T20:00:11.954ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11002025-01-16T20:00:11.954ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11012025-01-16T20:00:11.955ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11022025-01-16T20:00:11.956ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11032025-01-16T20:00:11.957ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11042025-01-16T20:00:11.958ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) } result = Ok(())
11052025-01-16T20:00:11.958ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = a3ac054c-111e-4219-bd7b-4e0a68319e1e roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
11062025-01-16T20:00:11.958ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = a3ac054c-111e-4219-bd7b-4e0a68319e1e resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
11072025-01-16T20:00:11.960ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = a3ac054c-111e-4219-bd7b-4e0a68319e1e roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
11082025-01-16T20:00:11.960ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = a3ac054c-111e-4219-bd7b-4e0a68319e1e resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
11092025-01-16T20:00:11.962ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = a3ac054c-111e-4219-bd7b-4e0a68319e1e roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
11102025-01-16T20:00:11.962ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = a3ac054c-111e-4219-bd7b-4e0a68319e1e resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
11112025-01-16T20:00:11.964ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = a3ac054c-111e-4219-bd7b-4e0a68319e1e roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
11122025-01-16T20:00:11.964ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = a3ac054c-111e-4219-bd7b-4e0a68319e1e resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
11132025-01-16T20:00:11.966ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = a3ac054c-111e-4219-bd7b-4e0a68319e1e roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
11142025-01-16T20:00:11.967ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = a3ac054c-111e-4219-bd7b-4e0a68319e1e resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
11152025-01-16T20:00:11.969ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = a3ac054c-111e-4219-bd7b-4e0a68319e1e roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
11162025-01-16T20:00:11.969ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = a3ac054c-111e-4219-bd7b-4e0a68319e1e resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
11172025-01-16T20:00:11.972ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = a3ac054c-111e-4219-bd7b-4e0a68319e1e roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
11182025-01-16T20:00:11.972ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = a3ac054c-111e-4219-bd7b-4e0a68319e1e resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
11192025-01-16T20:00:11.973ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = a3ac054c-111e-4219-bd7b-4e0a68319e1e roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
11202025-01-16T20:00:11.976ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = a3ac054c-111e-4219-bd7b-4e0a68319e1e resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
11212025-01-16T20:00:11.976ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
11222025-01-16T20:00:11.976ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
11232025-01-16T20:00:11.978ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
11242025-01-16T20:00:11.979ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
11252025-01-16T20:00:11.979ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
11262025-01-16T20:00:11.979ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
11272025-01-16T20:00:11.983ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete
11282025-01-16T20:00:11.983ZINFOnexus (SEC): saga create dag = {"end_node":5,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,0,null],[3,5,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_delete.instance_delete_nat","label":"InstanceDeleteNat","name":"no_result4"}},{"Action":{"action_name":"instance_delete.instance_delete_record","label":"InstanceDeleteRecord","name":"no_result1"}},{"Action":{"action_name":"instance_delete.delete_network_interfaces","label":"DeleteNetworkInterfaces","name":"no_result2"}},{"Action":{"action_name":"instance_delete.deallocate_external_ip","label":"DeallocateExternalIp","name":"no_result3"}},{"Start":{"params":{"authz_instance":{"key":"3de40729-f38e-405c-b30f-63d86ff0cdd0","lookup_type":{"ByName":"instance-15e37f20fef"},"parent":{"key":"3b7a3701-30a8-4657-a953-08ef3b6f1b29","lookup_type":{"ByName":"proj-1279a041a9e"},"parent":{"key":"197fa9bd-2b54-417a-8249-a5354e078485","lookup_type":{"ById":"197fa9bd-2b54-417a-8249-a5354e078485"},"parent":null}}},"boundary_switches":["switch0"],"instance":{"auto_restart":{"cooldown":null,"policy":null},"boot_disk_id":"ada4fced-de0a-4ecb-950f-3d3298809a3a","hostname":"localshark","identity":{"description":"","id":"3de40729-f38e-405c-b30f-63d86ff0cdd0","name":"instance-15e37f20fef","time_created":"2025-01-16T19:59:49.868141Z","time_deleted":null,"time_modified":"2025-01-16T19:59:49.868141Z"},"memory":1073741824,"ncpus":2,"project_id":"3b7a3701-30a8-4657-a953-08ef3b6f1b29","runtime_state":{"dst_propolis_id":null,"gen":3,"migration_id":null,"nexus_state":"Vmm","propolis_id":"92a6af21-e052-40a2-a996-c243f3f872d8","time_last_auto_restarted":null,"time_updated":"2025-01-16T19:59:49.868141Z"},"updater_gen":1,"updater_id":null,"user_data":[]},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"197fa9bd-2b54-417a-8249-a5354e078485","silo_user_id":"7dece980-441d-4848-943d-fffce58ad417"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"instance-delete","start_node":4} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
11292025-01-16T20:00:11.983ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete
11302025-01-16T20:00:11.991ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete
11312025-01-16T20:00:11.991ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
11322025-01-16T20:00:11.991ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
11332025-01-16T20:00:11.991ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64
11342025-01-16T20:00:11.997ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
11352025-01-16T20:00:11.997ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64
11362025-01-16T20:00:12.001ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
11372025-01-16T20:00:12.001ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64
11382025-01-16T20:00:12.005ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteNat
11392025-01-16T20:00:12.005ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteNat
11402025-01-16T20:00:12.007ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteNat
11412025-01-16T20:00:12.007ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteNat
11422025-01-16T20:00:12.008ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteNat
11432025-01-16T20:00:12.008ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteNat
11442025-01-16T20:00:12.010ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteNat
11452025-01-16T20:00:12.010ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteNat
11462025-01-16T20:00:12.012ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteNat
11472025-01-16T20:00:12.012ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteNat
11482025-01-16T20:00:12.014ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteNat
11492025-01-16T20:00:12.014ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteNat
11502025-01-16T20:00:12.017ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteNat
11512025-01-16T20:00:12.017ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteNat
11522025-01-16T20:00:12.019ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteNat
11532025-01-16T20:00:12.022ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ById(3b7a3701-30a8-4657-a953-08ef3b6f1b29) }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ById(3de40729-f38e-405c-b30f-63d86ff0cdd0) } result = Ok(()) saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteNat
11542025-01-16T20:00:12.022ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 3de40729-f38e-405c-b30f-63d86ff0cdd0
11552025-01-16T20:00:12.022ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteNat
11562025-01-16T20:00:12.022ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteNat
11572025-01-16T20:00:12.026ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteNat
11582025-01-16T20:00:12.027ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteNat
11592025-01-16T20:00:12.029ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
11602025-01-16T20:00:12.029ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteNat
11612025-01-16T20:00:12.029ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteNat
11622025-01-16T20:00:12.034ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
11632025-01-16T20:00:12.034ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
11642025-01-16T20:00:12.035ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
11652025-01-16T20:00:12.036ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
11662025-01-16T20:00:12.037ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
11672025-01-16T20:00:12.037ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
11682025-01-16T20:00:12.037ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
11692025-01-16T20:00:12.040ZDEBGnexus: notifying dendrite of updates instance_id = Some(3de40729-f38e-405c-b30f-63d86ff0cdd0 (instance)) switch = switch0
11702025-01-16T20:00:12.041ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1570, tv_nsec: 274411258 } })
11712025-01-16T20:00:12.041ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1104
11722025-01-16T20:00:12.072ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
11732025-01-16T20:00:12.072ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11742025-01-16T20:00:12.072ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5b11f47-0ace-4ff2-9d8a-db8283af2d88", "content-length": "26", "date": "Thu, 16 Jan 2025 20:00:12 GMT"} })
11752025-01-16T20:00:12.072ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11762025-01-16T20:00:12.073ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11772025-01-16T20:00:12.102ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
11782025-01-16T20:00:12.102ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cc30ee1-9a24-443a-ab06-58df5d97627d", "content-length": "4", "date": "Thu, 16 Jan 2025 20:00:11 GMT"} })
11792025-01-16T20:00:12.104ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
11802025-01-16T20:00:12.104ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 0 saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64
11812025-01-16T20:00:12.110ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
11822025-01-16T20:00:12.110ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64
11832025-01-16T20:00:12.114ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteRecord
11842025-01-16T20:00:12.115ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteRecord
11852025-01-16T20:00:12.117ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteRecord
11862025-01-16T20:00:12.117ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteRecord
11872025-01-16T20:00:12.120ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteRecord
11882025-01-16T20:00:12.120ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteRecord
11892025-01-16T20:00:12.122ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteRecord
11902025-01-16T20:00:12.122ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteRecord
11912025-01-16T20:00:12.125ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteRecord
11922025-01-16T20:00:12.128ZDEBGnexus (SagaExecutor): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteRecord
11932025-01-16T20:00:12.128ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteRecord
11942025-01-16T20:00:12.128ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_node = InstanceDeleteRecord
11952025-01-16T20:00:12.204ZDEBGnexus (SEC): saga log event new_state = N001 failed sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
11962025-01-16T20:00:12.204ZDEBGnexus (SecStore): recording saga event event_type = Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }) node_id = 1 saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64
11972025-01-16T20:00:12.208ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Unwinding saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
11982025-01-16T20:00:12.208ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = unwinding saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64
11992025-01-16T20:00:12.216ZDEBGnexus (SEC): saga log event new_state = N000 undo_started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
12002025-01-16T20:00:12.216ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 0 saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64
12012025-01-16T20:00:12.219ZDEBGnexus (SEC): saga log event new_state = N000 undo_finished sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
12022025-01-16T20:00:12.219ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 0 saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64
12032025-01-16T20:00:12.223ZDEBGnexus (SEC): saga log event new_state = N004 undo_started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
12042025-01-16T20:00:12.223ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 4 saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64
12052025-01-16T20:00:12.226ZDEBGnexus (SEC): saga log event new_state = N004 undo_finished sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
12062025-01-16T20:00:12.226ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 4 saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64
12072025-01-16T20:00:12.229ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
12082025-01-16T20:00:12.229ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64
12092025-01-16T20:00:12.235ZWARNnexus (SEC): saga finished action_error_node_name = "no_result1" action_error_source = ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} } file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1044 result = failure saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57 undo_result = success
12102025-01-16T20:00:12.235ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 7262086a-c0f6-4162-b571-6ea0f05c1b64 saga_name = instance-delete saga_result = SagaResult { saga_id: 7262086a-c0f6-4162-b571-6ea0f05c1b64, saga_log: SagaLog { saga_id: 7262086a-c0f6-4162-b571-6ea0f05c1b64, unwinding: true, events: [N004 started, N004 succeeded, N000 started, N000 succeeded, N001 started, N001 failed, N000 undo_started, N000 undo_finished, N004 undo_started, N004 undo_finished], node_status: {0: UndoFinished, 1: Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }), 4: UndoFinished} }, kind: Err(SagaResultErr { error_node_name: "no_result1", error_source: ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }, undo_failure: None }) }
12112025-01-16T20:00:12.235ZINFOnexus (dropshot_external): request completed error_message_external = cannot delete instance: instance is running or has not yet fully stopped error_message_internal = cannot delete instance: instance is running or has not yet fully stopped (with internal context: saga ACTION error at node "no_result1") file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 313346 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = a3ac054c-111e-4219-bd7b-4e0a68319e1e response_code = 400 uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
12122025-01-16T20:00:12.683ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:49474 method = GET remote_addr = [fd00:1122:3344:101::d]:39316 req_id = b3734529-2e1a-44a7-95b1-79bad32fe4e2 response_code = 200 uri = /3c6582d4-0e42-407f-bc66-e913ef1c0f57
12132025-01-16T20:00:12.837ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
12142025-01-16T20:00:12.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12152025-01-16T20:00:12.837ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
12162025-01-16T20:00:12.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12172025-01-16T20:00:12.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12182025-01-16T20:00:12.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12192025-01-16T20:00:12.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12202025-01-16T20:00:12.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12212025-01-16T20:00:12.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12222025-01-16T20:00:12.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12232025-01-16T20:00:12.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12242025-01-16T20:00:12.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12252025-01-16T20:00:12.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12262025-01-16T20:00:12.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 39de0ab7-8c61-46aa-88f2-d42db34dffb8, lookup_type: ById(39de0ab7-8c61-46aa-88f2-d42db34dffb8) } result = Ok(())
12272025-01-16T20:00:12.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12282025-01-16T20:00:12.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12292025-01-16T20:00:12.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 original_time_created = 2025-01-16 19:48:51.140214 UTC target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 time_created = 2025-01-16 19:48:51.140214 UTC
12302025-01-16T20:00:12.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.915837ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"39de0ab7-8c61-46aa-88f2-d42db34dffb8","time_created":"2025-01-16T19:48:51.140214Z"}
12312025-01-16T20:00:12.873ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12322025-01-16T20:00:12.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12332025-01-16T20:00:12.875ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.646078ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12342025-01-16T20:00:13.237ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12352025-01-16T20:00:13.237ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12362025-01-16T20:00:13.239ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12372025-01-16T20:00:13.239ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12382025-01-16T20:00:13.240ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
12392025-01-16T20:00:13.241ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("token = \\"9fc7fee85a0620a9929e974a7fc00e15c0f6724d\\"") } result = Ok(())
12402025-01-16T20:00:13.241ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12412025-01-16T20:00:13.241ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12422025-01-16T20:00:13.243ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12432025-01-16T20:00:13.243ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12442025-01-16T20:00:13.244ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12452025-01-16T20:00:13.245ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12462025-01-16T20:00:13.246ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12472025-01-16T20:00:13.246ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12482025-01-16T20:00:13.247ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
12492025-01-16T20:00:13.249ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
12502025-01-16T20:00:13.249ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12512025-01-16T20:00:13.249ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12522025-01-16T20:00:13.250ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
12532025-01-16T20:00:13.251ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("9fc7fee85a0620a9929e974a7fc00e15c0f6724d") } result = Ok(())
12542025-01-16T20:00:13.251ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12552025-01-16T20:00:13.251ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12562025-01-16T20:00:13.255ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12572025-01-16T20:00:13.255ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12582025-01-16T20:00:13.257ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12592025-01-16T20:00:13.257ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12602025-01-16T20:00:13.258ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12612025-01-16T20:00:13.258ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12622025-01-16T20:00:13.259ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12632025-01-16T20:00:13.260ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12642025-01-16T20:00:13.261ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
12652025-01-16T20:00:13.262ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
12662025-01-16T20:00:13.262ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12672025-01-16T20:00:13.262ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12682025-01-16T20:00:13.264ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12692025-01-16T20:00:13.264ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12702025-01-16T20:00:13.265ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12712025-01-16T20:00:13.265ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12722025-01-16T20:00:13.267ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
12732025-01-16T20:00:13.268ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) } result = Ok(())
12742025-01-16T20:00:13.268ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 1e73cabb-ba9e-4217-abc6-bff95e318790 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
12752025-01-16T20:00:13.268ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 1e73cabb-ba9e-4217-abc6-bff95e318790 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
12762025-01-16T20:00:13.269ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 1e73cabb-ba9e-4217-abc6-bff95e318790 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
12772025-01-16T20:00:13.270ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 1e73cabb-ba9e-4217-abc6-bff95e318790 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
12782025-01-16T20:00:13.271ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 1e73cabb-ba9e-4217-abc6-bff95e318790 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
12792025-01-16T20:00:13.271ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 1e73cabb-ba9e-4217-abc6-bff95e318790 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
12802025-01-16T20:00:13.273ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 1e73cabb-ba9e-4217-abc6-bff95e318790 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
12812025-01-16T20:00:13.274ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 1e73cabb-ba9e-4217-abc6-bff95e318790 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
12822025-01-16T20:00:13.276ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 1e73cabb-ba9e-4217-abc6-bff95e318790 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
12832025-01-16T20:00:13.276ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 1e73cabb-ba9e-4217-abc6-bff95e318790 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
12842025-01-16T20:00:13.278ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 1e73cabb-ba9e-4217-abc6-bff95e318790 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
12852025-01-16T20:00:13.278ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 1e73cabb-ba9e-4217-abc6-bff95e318790 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
12862025-01-16T20:00:13.281ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 1e73cabb-ba9e-4217-abc6-bff95e318790 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
12872025-01-16T20:00:13.281ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 1e73cabb-ba9e-4217-abc6-bff95e318790 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
12882025-01-16T20:00:13.283ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 1e73cabb-ba9e-4217-abc6-bff95e318790 roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
12892025-01-16T20:00:13.286ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 1e73cabb-ba9e-4217-abc6-bff95e318790 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
12902025-01-16T20:00:13.286ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
12912025-01-16T20:00:13.286ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
12922025-01-16T20:00:13.287ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
12932025-01-16T20:00:13.288ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
12942025-01-16T20:00:13.288ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
12952025-01-16T20:00:13.288ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
12962025-01-16T20:00:13.292ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete
12972025-01-16T20:00:13.292ZINFOnexus (SEC): saga create dag = {"end_node":5,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,0,null],[3,5,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_delete.instance_delete_nat","label":"InstanceDeleteNat","name":"no_result4"}},{"Action":{"action_name":"instance_delete.instance_delete_record","label":"InstanceDeleteRecord","name":"no_result1"}},{"Action":{"action_name":"instance_delete.delete_network_interfaces","label":"DeleteNetworkInterfaces","name":"no_result2"}},{"Action":{"action_name":"instance_delete.deallocate_external_ip","label":"DeallocateExternalIp","name":"no_result3"}},{"Start":{"params":{"authz_instance":{"key":"3de40729-f38e-405c-b30f-63d86ff0cdd0","lookup_type":{"ByName":"instance-15e37f20fef"},"parent":{"key":"3b7a3701-30a8-4657-a953-08ef3b6f1b29","lookup_type":{"ByName":"proj-1279a041a9e"},"parent":{"key":"197fa9bd-2b54-417a-8249-a5354e078485","lookup_type":{"ById":"197fa9bd-2b54-417a-8249-a5354e078485"},"parent":null}}},"boundary_switches":["switch0"],"instance":{"auto_restart":{"cooldown":null,"policy":null},"boot_disk_id":"ada4fced-de0a-4ecb-950f-3d3298809a3a","hostname":"localshark","identity":{"description":"","id":"3de40729-f38e-405c-b30f-63d86ff0cdd0","name":"instance-15e37f20fef","time_created":"2025-01-16T19:59:49.868141Z","time_deleted":null,"time_modified":"2025-01-16T19:59:49.868141Z"},"memory":1073741824,"ncpus":2,"project_id":"3b7a3701-30a8-4657-a953-08ef3b6f1b29","runtime_state":{"dst_propolis_id":null,"gen":3,"migration_id":null,"nexus_state":"Vmm","propolis_id":"92a6af21-e052-40a2-a996-c243f3f872d8","time_last_auto_restarted":null,"time_updated":"2025-01-16T19:59:49.868141Z"},"updater_gen":3,"updater_id":"d0028a96-f308-48c4-8700-3b8531fb980d","user_data":[]},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"197fa9bd-2b54-417a-8249-a5354e078485","silo_user_id":"7dece980-441d-4848-943d-fffce58ad417"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"instance-delete","start_node":4} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
12982025-01-16T20:00:13.292ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete
12992025-01-16T20:00:13.295ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete
13002025-01-16T20:00:13.295ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
13012025-01-16T20:00:13.295ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
13022025-01-16T20:00:13.295ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc
13032025-01-16T20:00:13.299ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
13042025-01-16T20:00:13.299ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc
13052025-01-16T20:00:13.303ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
13062025-01-16T20:00:13.303ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc
13072025-01-16T20:00:13.305ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteNat
13082025-01-16T20:00:13.306ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteNat
13092025-01-16T20:00:13.307ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteNat
13102025-01-16T20:00:13.307ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteNat
13112025-01-16T20:00:13.308ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteNat
13122025-01-16T20:00:13.308ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteNat
13132025-01-16T20:00:13.309ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteNat
13142025-01-16T20:00:13.310ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteNat
13152025-01-16T20:00:13.311ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteNat
13162025-01-16T20:00:13.312ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteNat
13172025-01-16T20:00:13.314ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteNat
13182025-01-16T20:00:13.314ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteNat
13192025-01-16T20:00:13.316ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteNat
13202025-01-16T20:00:13.317ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteNat
13212025-01-16T20:00:13.319ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteNat
13222025-01-16T20:00:13.322ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ById(3b7a3701-30a8-4657-a953-08ef3b6f1b29) }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ById(3de40729-f38e-405c-b30f-63d86ff0cdd0) } result = Ok(()) saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteNat
13232025-01-16T20:00:13.322ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 3de40729-f38e-405c-b30f-63d86ff0cdd0
13242025-01-16T20:00:13.322ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteNat
13252025-01-16T20:00:13.322ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteNat
13262025-01-16T20:00:13.324ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteNat
13272025-01-16T20:00:13.324ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteNat
13282025-01-16T20:00:13.326ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
13292025-01-16T20:00:13.326ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteNat
13302025-01-16T20:00:13.326ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteNat
13312025-01-16T20:00:13.328ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
13322025-01-16T20:00:13.328ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
13332025-01-16T20:00:13.328ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
13342025-01-16T20:00:13.329ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
13352025-01-16T20:00:13.330ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
13362025-01-16T20:00:13.330ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
13372025-01-16T20:00:13.330ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
13382025-01-16T20:00:13.333ZDEBGnexus: notifying dendrite of updates instance_id = Some(3de40729-f38e-405c-b30f-63d86ff0cdd0 (instance)) switch = switch0
13392025-01-16T20:00:13.334ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1571, tv_nsec: 567128312 } })
13402025-01-16T20:00:13.334ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1104
13412025-01-16T20:00:13.364ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
13422025-01-16T20:00:13.364ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13432025-01-16T20:00:13.364ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f6a09a5-5f10-44a9-a89e-793989ae4388", "content-length": "26", "date": "Thu, 16 Jan 2025 20:00:13 GMT"} })
13442025-01-16T20:00:13.364ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13452025-01-16T20:00:13.365ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13462025-01-16T20:00:13.393ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
13472025-01-16T20:00:13.393ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "83f7a598-4257-4b1c-8909-4f0d87b41985", "content-length": "4", "date": "Thu, 16 Jan 2025 20:00:12 GMT"} })
13482025-01-16T20:00:13.394ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
13492025-01-16T20:00:13.394ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 0 saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc
13502025-01-16T20:00:13.398ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
13512025-01-16T20:00:13.398ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc
13522025-01-16T20:00:13.401ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteRecord
13532025-01-16T20:00:13.402ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteRecord
13542025-01-16T20:00:13.404ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteRecord
13552025-01-16T20:00:13.404ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteRecord
13562025-01-16T20:00:13.407ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteRecord
13572025-01-16T20:00:13.407ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteRecord
13582025-01-16T20:00:13.409ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteRecord
13592025-01-16T20:00:13.409ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteRecord
13602025-01-16T20:00:13.412ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteRecord
13612025-01-16T20:00:13.415ZDEBGnexus (SagaExecutor): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteRecord
13622025-01-16T20:00:13.415ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteRecord
13632025-01-16T20:00:13.415ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_node = InstanceDeleteRecord
13642025-01-16T20:00:13.484ZDEBGnexus (SEC): saga log event new_state = N001 failed sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
13652025-01-16T20:00:13.484ZDEBGnexus (SecStore): recording saga event event_type = Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }) node_id = 1 saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc
13662025-01-16T20:00:13.487ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Unwinding saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
13672025-01-16T20:00:13.487ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = unwinding saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc
13682025-01-16T20:00:13.495ZDEBGnexus (SEC): saga log event new_state = N000 undo_started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
13692025-01-16T20:00:13.495ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 0 saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc
13702025-01-16T20:00:13.500ZDEBGnexus (SEC): saga log event new_state = N000 undo_finished sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
13712025-01-16T20:00:13.500ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 0 saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc
13722025-01-16T20:00:13.504ZDEBGnexus (SEC): saga log event new_state = N004 undo_started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
13732025-01-16T20:00:13.504ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 4 saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc
13742025-01-16T20:00:13.509ZDEBGnexus (SEC): saga log event new_state = N004 undo_finished sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
13752025-01-16T20:00:13.509ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 4 saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc
13762025-01-16T20:00:13.512ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
13772025-01-16T20:00:13.512ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc
13782025-01-16T20:00:13.519ZWARNnexus (SEC): saga finished action_error_node_name = "no_result1" action_error_source = ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} } file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1044 result = failure saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57 undo_result = success
13792025-01-16T20:00:13.519ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc saga_name = instance-delete saga_result = SagaResult { saga_id: adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc, saga_log: SagaLog { saga_id: adbed8d9-036e-4cf6-84b3-0d5d7ca2b6fc, unwinding: true, events: [N004 started, N004 succeeded, N000 started, N000 succeeded, N001 started, N001 failed, N000 undo_started, N000 undo_finished, N004 undo_started, N004 undo_finished], node_status: {0: UndoFinished, 1: Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }), 4: UndoFinished} }, kind: Err(SagaResultErr { error_node_name: "no_result1", error_source: ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }, undo_failure: None }) }
13802025-01-16T20:00:13.519ZINFOnexus (dropshot_external): request completed error_message_external = cannot delete instance: instance is running or has not yet fully stopped error_message_internal = cannot delete instance: instance is running or has not yet fully stopped (with internal context: saga ACTION error at node "no_result1") file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 281990 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 1e73cabb-ba9e-4217-abc6-bff95e318790 response_code = 400 uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
13812025-01-16T20:00:14.521ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13822025-01-16T20:00:14.522ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13832025-01-16T20:00:14.523ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13842025-01-16T20:00:14.523ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13852025-01-16T20:00:14.525ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
13862025-01-16T20:00:14.527ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("token = \\"9fc7fee85a0620a9929e974a7fc00e15c0f6724d\\"") } result = Ok(())
13872025-01-16T20:00:14.527ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13882025-01-16T20:00:14.527ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13892025-01-16T20:00:14.529ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13902025-01-16T20:00:14.529ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13912025-01-16T20:00:14.531ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13922025-01-16T20:00:14.531ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13932025-01-16T20:00:14.533ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13942025-01-16T20:00:14.533ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13952025-01-16T20:00:14.534ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
13962025-01-16T20:00:14.536ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
13972025-01-16T20:00:14.536ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13982025-01-16T20:00:14.536ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13992025-01-16T20:00:14.538ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
14002025-01-16T20:00:14.539ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("9fc7fee85a0620a9929e974a7fc00e15c0f6724d") } result = Ok(())
14012025-01-16T20:00:14.539ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
14022025-01-16T20:00:14.539ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
14032025-01-16T20:00:14.543ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
14042025-01-16T20:00:14.544ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
14052025-01-16T20:00:14.545ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
14062025-01-16T20:00:14.545ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
14072025-01-16T20:00:14.547ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
14082025-01-16T20:00:14.547ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
14092025-01-16T20:00:14.548ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
14102025-01-16T20:00:14.548ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
14112025-01-16T20:00:14.550ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
14122025-01-16T20:00:14.551ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
14132025-01-16T20:00:14.551ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
14142025-01-16T20:00:14.551ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
14152025-01-16T20:00:14.552ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
14162025-01-16T20:00:14.552ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
14172025-01-16T20:00:14.554ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
14182025-01-16T20:00:14.554ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
14192025-01-16T20:00:14.556ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
14202025-01-16T20:00:14.557ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) } result = Ok(())
14212025-01-16T20:00:14.557ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 151a51c5-b045-478f-9c8c-a78cad4ad149 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
14222025-01-16T20:00:14.557ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 151a51c5-b045-478f-9c8c-a78cad4ad149 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
14232025-01-16T20:00:14.558ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 151a51c5-b045-478f-9c8c-a78cad4ad149 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
14242025-01-16T20:00:14.558ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 151a51c5-b045-478f-9c8c-a78cad4ad149 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
14252025-01-16T20:00:14.560ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 151a51c5-b045-478f-9c8c-a78cad4ad149 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
14262025-01-16T20:00:14.560ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 151a51c5-b045-478f-9c8c-a78cad4ad149 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
14272025-01-16T20:00:14.562ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 151a51c5-b045-478f-9c8c-a78cad4ad149 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
14282025-01-16T20:00:14.562ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 151a51c5-b045-478f-9c8c-a78cad4ad149 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
14292025-01-16T20:00:14.564ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 151a51c5-b045-478f-9c8c-a78cad4ad149 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
14302025-01-16T20:00:14.565ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 151a51c5-b045-478f-9c8c-a78cad4ad149 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
14312025-01-16T20:00:14.567ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 151a51c5-b045-478f-9c8c-a78cad4ad149 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
14322025-01-16T20:00:14.567ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 151a51c5-b045-478f-9c8c-a78cad4ad149 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
14332025-01-16T20:00:14.570ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 151a51c5-b045-478f-9c8c-a78cad4ad149 roles = RoleSet { roles: {} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
14342025-01-16T20:00:14.570ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 151a51c5-b045-478f-9c8c-a78cad4ad149 resource = Database result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
14352025-01-16T20:00:14.572ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 151a51c5-b045-478f-9c8c-a78cad4ad149 roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
14362025-01-16T20:00:14.575ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 151a51c5-b045-478f-9c8c-a78cad4ad149 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
14372025-01-16T20:00:14.575ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
14382025-01-16T20:00:14.575ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
14392025-01-16T20:00:14.576ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
14402025-01-16T20:00:14.577ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
14412025-01-16T20:00:14.577ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
14422025-01-16T20:00:14.577ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
14432025-01-16T20:00:14.582ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete
14442025-01-16T20:00:14.582ZINFOnexus (SEC): saga create dag = {"end_node":5,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,0,null],[3,5,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_delete.instance_delete_nat","label":"InstanceDeleteNat","name":"no_result4"}},{"Action":{"action_name":"instance_delete.instance_delete_record","label":"InstanceDeleteRecord","name":"no_result1"}},{"Action":{"action_name":"instance_delete.delete_network_interfaces","label":"DeleteNetworkInterfaces","name":"no_result2"}},{"Action":{"action_name":"instance_delete.deallocate_external_ip","label":"DeallocateExternalIp","name":"no_result3"}},{"Start":{"params":{"authz_instance":{"key":"3de40729-f38e-405c-b30f-63d86ff0cdd0","lookup_type":{"ByName":"instance-15e37f20fef"},"parent":{"key":"3b7a3701-30a8-4657-a953-08ef3b6f1b29","lookup_type":{"ByName":"proj-1279a041a9e"},"parent":{"key":"197fa9bd-2b54-417a-8249-a5354e078485","lookup_type":{"ById":"197fa9bd-2b54-417a-8249-a5354e078485"},"parent":null}}},"boundary_switches":["switch0"],"instance":{"auto_restart":{"cooldown":null,"policy":null},"boot_disk_id":"ada4fced-de0a-4ecb-950f-3d3298809a3a","hostname":"localshark","identity":{"description":"","id":"3de40729-f38e-405c-b30f-63d86ff0cdd0","name":"instance-15e37f20fef","time_created":"2025-01-16T19:59:49.868141Z","time_deleted":null,"time_modified":"2025-01-16T19:59:49.868141Z"},"memory":1073741824,"ncpus":2,"project_id":"3b7a3701-30a8-4657-a953-08ef3b6f1b29","runtime_state":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-01-16T20:00:13.125742Z"},"updater_gen":4,"updater_id":null,"user_data":[]},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"197fa9bd-2b54-417a-8249-a5354e078485","silo_user_id":"7dece980-441d-4848-943d-fffce58ad417"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"instance-delete","start_node":4} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
14452025-01-16T20:00:14.582ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete
14462025-01-16T20:00:14.586ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete
14472025-01-16T20:00:14.586ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
14482025-01-16T20:00:14.586ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
14492025-01-16T20:00:14.586ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf
14502025-01-16T20:00:14.591ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
14512025-01-16T20:00:14.591ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf
14522025-01-16T20:00:14.594ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
14532025-01-16T20:00:14.594ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf
14542025-01-16T20:00:14.598ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteNat
14552025-01-16T20:00:14.598ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteNat
14562025-01-16T20:00:14.600ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteNat
14572025-01-16T20:00:14.600ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteNat
14582025-01-16T20:00:14.601ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteNat
14592025-01-16T20:00:14.601ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteNat
14602025-01-16T20:00:14.602ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteNat
14612025-01-16T20:00:14.603ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteNat
14622025-01-16T20:00:14.605ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteNat
14632025-01-16T20:00:14.605ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteNat
14642025-01-16T20:00:14.607ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteNat
14652025-01-16T20:00:14.607ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteNat
14662025-01-16T20:00:14.609ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteNat
14672025-01-16T20:00:14.609ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteNat
14682025-01-16T20:00:14.611ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteNat
14692025-01-16T20:00:14.614ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ById(3b7a3701-30a8-4657-a953-08ef3b6f1b29) }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ById(3de40729-f38e-405c-b30f-63d86ff0cdd0) } result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteNat
14702025-01-16T20:00:14.614ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 3de40729-f38e-405c-b30f-63d86ff0cdd0
14712025-01-16T20:00:14.614ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteNat
14722025-01-16T20:00:14.614ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteNat
14732025-01-16T20:00:14.616ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteNat
14742025-01-16T20:00:14.616ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteNat
14752025-01-16T20:00:14.618ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
14762025-01-16T20:00:14.618ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteNat
14772025-01-16T20:00:14.618ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteNat
14782025-01-16T20:00:14.620ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
14792025-01-16T20:00:14.620ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
14802025-01-16T20:00:14.620ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
14812025-01-16T20:00:14.621ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
14822025-01-16T20:00:14.622ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
14832025-01-16T20:00:14.622ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
14842025-01-16T20:00:14.622ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
14852025-01-16T20:00:14.626ZDEBGnexus: notifying dendrite of updates instance_id = Some(3de40729-f38e-405c-b30f-63d86ff0cdd0 (instance)) switch = switch0
14862025-01-16T20:00:14.626ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1572, tv_nsec: 859650482 } })
14872025-01-16T20:00:14.626ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1104
14882025-01-16T20:00:14.656ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
14892025-01-16T20:00:14.657ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14902025-01-16T20:00:14.657ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ac79879-da75-473c-b15c-f88ecffda903", "content-length": "26", "date": "Thu, 16 Jan 2025 20:00:14 GMT"} })
14912025-01-16T20:00:14.657ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14922025-01-16T20:00:14.657ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14932025-01-16T20:00:14.687ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
14942025-01-16T20:00:14.687ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a8833d1-5c4d-4166-8ed8-83e3224263e0", "content-length": "4", "date": "Thu, 16 Jan 2025 20:00:13 GMT"} })
14952025-01-16T20:00:14.688ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
14962025-01-16T20:00:14.688ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 0 saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf
14972025-01-16T20:00:14.691ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
14982025-01-16T20:00:14.691ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf
14992025-01-16T20:00:14.695ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteRecord
15002025-01-16T20:00:14.695ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteRecord
15012025-01-16T20:00:14.697ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteRecord
15022025-01-16T20:00:14.697ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteRecord
15032025-01-16T20:00:14.700ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteRecord
15042025-01-16T20:00:14.700ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteRecord
15052025-01-16T20:00:14.702ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteRecord
15062025-01-16T20:00:14.702ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteRecord
15072025-01-16T20:00:14.705ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteRecord
15082025-01-16T20:00:14.708ZDEBGnexus (SagaExecutor): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteRecord
15092025-01-16T20:00:14.708ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteRecord
15102025-01-16T20:00:14.708ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteRecord
15112025-01-16T20:00:14.786ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteRecord
15122025-01-16T20:00:14.787ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteRecord
15132025-01-16T20:00:14.886ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteRecord
15142025-01-16T20:00:14.886ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = InstanceDeleteRecord
15152025-01-16T20:00:14.889ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
15162025-01-16T20:00:14.889ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf
15172025-01-16T20:00:14.893ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
15182025-01-16T20:00:14.893ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf
15192025-01-16T20:00:14.896ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = DeleteNetworkInterfaces
15202025-01-16T20:00:14.897ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = DeleteNetworkInterfaces
15212025-01-16T20:00:14.899ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = DeleteNetworkInterfaces
15222025-01-16T20:00:14.899ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = DeleteNetworkInterfaces
15232025-01-16T20:00:14.901ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = DeleteNetworkInterfaces
15242025-01-16T20:00:14.902ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = DeleteNetworkInterfaces
15252025-01-16T20:00:14.904ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = DeleteNetworkInterfaces
15262025-01-16T20:00:14.904ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = DeleteNetworkInterfaces
15272025-01-16T20:00:14.907ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = DeleteNetworkInterfaces
15282025-01-16T20:00:14.910ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: 3de40729-f38e-405c-b30f-63d86ff0cdd0, lookup_type: ByName("instance-15e37f20fef") } result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = DeleteNetworkInterfaces
15292025-01-16T20:00:14.910ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = DeleteNetworkInterfaces
15302025-01-16T20:00:14.910ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = DeleteNetworkInterfaces
15312025-01-16T20:00:14.945ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
15322025-01-16T20:00:14.945ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Signaled
15332025-01-16T20:00:14.945ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf
15342025-01-16T20:00:14.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15352025-01-16T20:00:14.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15362025-01-16T20:00:14.950ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
15372025-01-16T20:00:14.950ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf
15382025-01-16T20:00:14.953ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = DeallocateExternalIp
15392025-01-16T20:00:14.953ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = DeallocateExternalIp
15402025-01-16T20:00:14.956ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15412025-01-16T20:00:14.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15422025-01-16T20:00:14.963ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = DeallocateExternalIp
15432025-01-16T20:00:14.964ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_node = DeallocateExternalIp
15442025-01-16T20:00:15.016ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
15452025-01-16T20:00:15.016ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf
15462025-01-16T20:00:15.021ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
15472025-01-16T20:00:15.021ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf
15482025-01-16T20:00:15.025ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
15492025-01-16T20:00:15.025ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf
15502025-01-16T20:00:15.026ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15512025-01-16T20:00:15.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15522025-01-16T20:00:15.028ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15532025-01-16T20:00:15.029ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
15542025-01-16T20:00:15.029ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf
15552025-01-16T20:00:15.030ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15562025-01-16T20:00:15.030ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15572025-01-16T20:00:15.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15582025-01-16T20:00:15.031ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15592025-01-16T20:00:15.033ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15602025-01-16T20:00:15.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15612025-01-16T20:00:15.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15622025-01-16T20:00:15.036ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
15632025-01-16T20:00:15.036ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = c3c5d615-8f8b-4cb8-b271-7577354b9edf saga_name = instance-delete saga_result = SagaResult { saga_id: c3c5d615-8f8b-4cb8-b271-7577354b9edf, saga_log: SagaLog { saga_id: c3c5d615-8f8b-4cb8-b271-7577354b9edf, unwinding: false, events: [N004 started, N004 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N005 started, N005 succeeded], node_status: {0: Succeeded(Null), 1: Succeeded(Null), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"no_result1": Null, "no_result2": Null, "no_result3": Null, "no_result4": Null} }) }
15642025-01-16T20:00:15.036ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Signaled
15652025-01-16T20:00:15.036ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 515163 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 151a51c5-b045-478f-9c8c-a78cad4ad149 response_code = 204 uri = /v1/instances/instance-15e37f20fef?project=proj-1279a041a9e
15662025-01-16T20:00:15.036ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
15672025-01-16T20:00:15.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15682025-01-16T20:00:15.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15692025-01-16T20:00:15.037ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15702025-01-16T20:00:15.038ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15712025-01-16T20:00:15.038ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15722025-01-16T20:00:15.039ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15732025-01-16T20:00:15.039ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15742025-01-16T20:00:15.040ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15752025-01-16T20:00:15.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15762025-01-16T20:00:15.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15772025-01-16T20:00:15.040ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
15782025-01-16T20:00:15.041ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15792025-01-16T20:00:15.042ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("token = \\"9fc7fee85a0620a9929e974a7fc00e15c0f6724d\\"") } result = Ok(())
15802025-01-16T20:00:15.042ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15812025-01-16T20:00:15.042ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15822025-01-16T20:00:15.043ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15832025-01-16T20:00:15.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15842025-01-16T20:00:15.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15852025-01-16T20:00:15.066ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
15862025-01-16T20:00:15.067ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6a636e4-69c3-46bf-88b2-74f77e1668c9", "content-length": "691", "date": "Thu, 16 Jan 2025 20:00:15 GMT"} })
15872025-01-16T20:00:15.067ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
15882025-01-16T20:00:15.067ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
15892025-01-16T20:00:15.067ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
15902025-01-16T20:00:15.068ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 122.53165ms iteration = 25 status = {}
15912025-01-16T20:00:15.068ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15922025-01-16T20:00:15.069ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15932025-01-16T20:00:15.070ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15942025-01-16T20:00:15.070ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15952025-01-16T20:00:15.072ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15962025-01-16T20:00:15.072ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15972025-01-16T20:00:15.073ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
15982025-01-16T20:00:15.074ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
15992025-01-16T20:00:15.074ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16002025-01-16T20:00:15.074ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16012025-01-16T20:00:15.076ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
16022025-01-16T20:00:15.077ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("9fc7fee85a0620a9929e974a7fc00e15c0f6724d") } result = Ok(())
16032025-01-16T20:00:15.077ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16042025-01-16T20:00:15.077ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16052025-01-16T20:00:15.099ZINFOnexus (BackgroundTasks): VPC route manager sled 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
16062025-01-16T20:00:15.099ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16072025-01-16T20:00:15.100ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffa6a80f-8ae7-48a1-9b85-34a7cfa63700", "content-length": "372", "date": "Thu, 16 Jan 2025 20:00:15 GMT"} })
16082025-01-16T20:00:15.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16092025-01-16T20:00:15.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16102025-01-16T20:00:15.103ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16112025-01-16T20:00:15.103ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16122025-01-16T20:00:15.105ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16132025-01-16T20:00:15.105ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16142025-01-16T20:00:15.106ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16152025-01-16T20:00:15.106ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16162025-01-16T20:00:15.108ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16172025-01-16T20:00:15.108ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16182025-01-16T20:00:15.109ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
16192025-01-16T20:00:15.111ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
16202025-01-16T20:00:15.111ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16212025-01-16T20:00:15.111ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16222025-01-16T20:00:15.112ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16232025-01-16T20:00:15.113ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16242025-01-16T20:00:15.114ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
16252025-01-16T20:00:15.114ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16262025-01-16T20:00:15.114ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "05f0e8b2-782a-4af8-9ba6-d8506b2f3cd0", "date": "Thu, 16 Jan 2025 20:00:15 GMT"} })
16272025-01-16T20:00:15.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16282025-01-16T20:00:15.114ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16292025-01-16T20:00:15.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16302025-01-16T20:00:15.114ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16312025-01-16T20:00:15.116ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16322025-01-16T20:00:15.116ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
16332025-01-16T20:00:15.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16342025-01-16T20:00:15.117ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) } result = Ok(())
16352025-01-16T20:00:15.117ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa roles = RoleSet { roles: {} } uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16362025-01-16T20:00:15.117ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa resource = Database result = Ok(()) uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16372025-01-16T20:00:15.118ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16382025-01-16T20:00:15.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16392025-01-16T20:00:15.119ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa roles = RoleSet { roles: {} } uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16402025-01-16T20:00:15.119ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa resource = Database result = Ok(()) uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16412025-01-16T20:00:15.121ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa roles = RoleSet { roles: {} } uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16422025-01-16T20:00:15.121ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa resource = Database result = Ok(()) uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16432025-01-16T20:00:15.121ZINFOnexus (BackgroundTasks): VPC route manager sled 87207105-a825-4eaa-ac6d-6aaa586b0fc5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16442025-01-16T20:00:15.121ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16452025-01-16T20:00:15.122ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0017b662-9f54-4abd-bd0b-07b63dff7b5f", "date": "Thu, 16 Jan 2025 20:00:15 GMT"} })
16462025-01-16T20:00:15.123ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa roles = RoleSet { roles: {} } uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16472025-01-16T20:00:15.123ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa resource = Database result = Ok(()) uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16482025-01-16T20:00:15.123ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 86.958716ms iteration = 26 status = {}
16492025-01-16T20:00:15.125ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa roles = RoleSet { roles: {} } uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16502025-01-16T20:00:15.125ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa resource = Database result = Ok(()) uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16512025-01-16T20:00:15.127ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa roles = RoleSet { roles: {} } uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16522025-01-16T20:00:15.128ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa resource = Database result = Ok(()) uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16532025-01-16T20:00:15.130ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa roles = RoleSet { roles: {} } uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16542025-01-16T20:00:15.130ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa resource = Database result = Ok(()) uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16552025-01-16T20:00:15.132ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16562025-01-16T20:00:15.134ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: ada4fced-de0a-4ecb-950f-3d3298809a3a, lookup_type: ByName("disk-e84f90b1883") } result = Ok(()) uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16572025-01-16T20:00:15.134ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa roles = RoleSet { roles: {} } uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16582025-01-16T20:00:15.135ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa resource = Database result = Ok(()) uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16592025-01-16T20:00:15.136ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa roles = RoleSet { roles: {} } uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16602025-01-16T20:00:15.136ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa resource = Database result = Ok(()) uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16612025-01-16T20:00:15.138ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa roles = RoleSet { roles: {} } uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16622025-01-16T20:00:15.138ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa resource = Database result = Ok(()) uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16632025-01-16T20:00:15.139ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa roles = RoleSet { roles: {} } uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16642025-01-16T20:00:15.139ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa resource = Database result = Ok(()) uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16652025-01-16T20:00:15.141ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa roles = RoleSet { roles: {} } uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16662025-01-16T20:00:15.141ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa resource = Database result = Ok(()) uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16672025-01-16T20:00:15.143ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa roles = RoleSet { roles: {} } uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16682025-01-16T20:00:15.143ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa resource = Database result = Ok(()) uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16692025-01-16T20:00:15.146ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa roles = RoleSet { roles: {} } uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16702025-01-16T20:00:15.146ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa resource = Database result = Ok(()) uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16712025-01-16T20:00:15.148ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16722025-01-16T20:00:15.151ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ById(3b7a3701-30a8-4657-a953-08ef3b6f1b29) }, key: ada4fced-de0a-4ecb-950f-3d3298809a3a, lookup_type: ById(ada4fced-de0a-4ecb-950f-3d3298809a3a) } result = Ok(()) uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
16732025-01-16T20:00:15.151ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190 saga_name = disk-delete
16742025-01-16T20:00:15.151ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,5,null],[4,6,null],[6,7,null],[5,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[3,4,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"disk_delete.delete_disk_record","label":"DeleteDiskRecord","name":"deleted_disk"}},{"Action":{"action_name":"disk_delete.space_account","label":"SpaceAccount","name":"no_result1"}},{"Constant":{"name":"params_for_volume_delete_subsaga","value":{"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"197fa9bd-2b54-417a-8249-a5354e078485","silo_user_id":"7dece980-441d-4848-943d-fffce58ad417"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"2843f680-659d-476b-ac7e-430cc4908043"}}},{"SubsagaStart":{"params_node_name":"params_for_volume_delete_subsaga","saga_name":"volume-delete"}},{"Action":{"action_name":"volume_delete.decrease_crucible_resource_count","label":"DecreaseCrucibleResourceCount","name":"crucible_resources_to_delete"}},{"Action":{"action_name":"volume_delete.delete_crucible_regions","label":"DeleteCrucibleRegions","name":"no_result_1"}},{"Action":{"action_name":"volume_delete.delete_crucible_running_snapshots","label":"DeleteCrucibleRunningSnapshots","name":"no_result_2"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshots","label":"DeleteCrucibleSnapshots","name":"no_result_3"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshot_records","label":"DeleteCrucibleSnapshotRecords","name":"no_result_4"}},{"Action":{"action_name":"volume_delete.find_freed_crucible_regions","label":"FindFreedCrucibleRegions","name":"freed_crucible_regions"}},{"Action":{"action_name":"volume_delete.delete_freed_crucible_regions","label":"DeleteFreedCrucibleRegions","name":"no_result_5"}},{"Action":{"action_name":"volume_delete.hard_delete_volume_record","label":"HardDeleteVolumeRecord","name":"volume_hard_deleted"}},{"SubsagaEnd":{"name":"volume_delete_subsaga_no_result"}},{"Start":{"params":{"disk_id":"ada4fced-de0a-4ecb-950f-3d3298809a3a","project_id":"3b7a3701-30a8-4657-a953-08ef3b6f1b29","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"197fa9bd-2b54-417a-8249-a5354e078485","silo_user_id":"7dece980-441d-4848-943d-fffce58ad417"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"2843f680-659d-476b-ac7e-430cc4908043"}}},"End"]},"saga_name":"disk-delete","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190 saga_name = disk-delete sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
16752025-01-16T20:00:15.151ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190 saga_name = disk-delete
16762025-01-16T20:00:15.156ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190 saga_name = disk-delete
16772025-01-16T20:00:15.156ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190 saga_name = disk-delete sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
16782025-01-16T20:00:15.156ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
16792025-01-16T20:00:15.156ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
16802025-01-16T20:00:15.168ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
16812025-01-16T20:00:15.168ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
16822025-01-16T20:00:15.176ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
16832025-01-16T20:00:15.176ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
16842025-01-16T20:00:15.194ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
16852025-01-16T20:00:15.194ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": String("fd440cca-bca6-4b8c-8d5d-e75eba20cebb"), "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("ada4fced-de0a-4ecb-950f-3d3298809a3a"), "name": String("disk-e84f90b1883"), "time_created": String("2025-01-16T19:59:48.352426Z"), "time_deleted": Null, "time_modified": String("2025-01-16T19:59:48.352426Z")}, "pantry_address": Null, "project_id": String("3b7a3701-30a8-4657-a953-08ef3b6f1b29"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2025-01-16T19:59:49.677847Z")}, "size": Number(2147483648), "slot": Null, "volume_id": String("2843f680-659d-476b-ac7e-430cc4908043")}) node_id = 0 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
16862025-01-16T20:00:15.199ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
16872025-01-16T20:00:15.199ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
16882025-01-16T20:00:15.203ZDEBGnexus (SagaExecutor): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true roles = RoleSet { roles: {} } saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190 saga_name = disk-delete saga_node = SpaceAccount
16892025-01-16T20:00:15.203ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true resource = Database result = Ok(()) saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190 saga_name = disk-delete saga_node = SpaceAccount
16902025-01-16T20:00:15.220ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
16912025-01-16T20:00:15.220ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
16922025-01-16T20:00:15.225ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
16932025-01-16T20:00:15.225ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
16942025-01-16T20:00:15.229ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
16952025-01-16T20:00:15.229ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("197fa9bd-2b54-417a-8249-a5354e078485"), "silo_user_id": String("7dece980-441d-4848-943d-fffce58ad417")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("2843f680-659d-476b-ac7e-430cc4908043")}) node_id = 2 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
16962025-01-16T20:00:15.233ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
16972025-01-16T20:00:15.233ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
16982025-01-16T20:00:15.237ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
16992025-01-16T20:00:15.237ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
17002025-01-16T20:00:15.241ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
17012025-01-16T20:00:15.241ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
17022025-01-16T20:00:15.303ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
17032025-01-16T20:00:15.303ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("05042cbd-5b4b-46cc-aa9c-7c8b8c245645"), String("e6942525-1962-4188-8116-cbc30c69a3ff"), String("3bd3c5ef-0997-4225-a470-1cce445ba731")]}}) node_id = 4 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
17042025-01-16T20:00:15.307ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
17052025-01-16T20:00:15.307ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
17062025-01-16T20:00:15.310ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
17072025-01-16T20:00:15.310ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
17082025-01-16T20:00:15.315ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
17092025-01-16T20:00:15.315ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
17102025-01-16T20:00:15.352ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 90.682394ms file = nexus/src/app/crucible.rs:828 region_id = 3bd3c5ef-0997-4225-a470-1cce445ba731 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190 saga_name = disk-delete
17112025-01-16T20:00:15.352ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 131.78105ms file = nexus/src/app/crucible.rs:828 region_id = e6942525-1962-4188-8116-cbc30c69a3ff saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190 saga_name = disk-delete
17122025-01-16T20:00:15.353ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 145.520033ms file = nexus/src/app/crucible.rs:828 region_id = 05042cbd-5b4b-46cc-aa9c-7c8b8c245645 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190 saga_name = disk-delete
17132025-01-16T20:00:15.448ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = 3bd3c5ef-0997-4225-a470-1cce445ba731 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190 saga_name = disk-delete
17142025-01-16T20:00:15.488ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = e6942525-1962-4188-8116-cbc30c69a3ff saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190 saga_name = disk-delete
17152025-01-16T20:00:15.503ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = 05042cbd-5b4b-46cc-aa9c-7c8b8c245645 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190 saga_name = disk-delete
17162025-01-16T20:00:15.542ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
17172025-01-16T20:00:15.542ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
17182025-01-16T20:00:15.548ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
17192025-01-16T20:00:15.548ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
17202025-01-16T20:00:15.554ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
17212025-01-16T20:00:15.554ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
17222025-01-16T20:00:15.559ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
17232025-01-16T20:00:15.559ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
17242025-01-16T20:00:15.563ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
17252025-01-16T20:00:15.563ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
17262025-01-16T20:00:15.567ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
17272025-01-16T20:00:15.567ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
17282025-01-16T20:00:15.577ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
17292025-01-16T20:00:15.577ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"datasets_and_regions": Array [], "volumes": Array []}) node_id = 9 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
17302025-01-16T20:00:15.580ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
17312025-01-16T20:00:15.580ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
17322025-01-16T20:00:15.584ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
17332025-01-16T20:00:15.584ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
17342025-01-16T20:00:15.587ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
17352025-01-16T20:00:15.587ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
17362025-01-16T20:00:15.593ZINFOnexus (SagaExecutor): allocated regions for 2843f680-659d-476b-ac7e-430cc4908043 is empty, calling volume_hard_delete file = nexus/src/app/sagas/volume_delete.rs:523 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190 saga_name = disk-delete
17372025-01-16T20:00:15.597ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
17382025-01-16T20:00:15.597ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 11 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
17392025-01-16T20:00:15.601ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
17402025-01-16T20:00:15.601ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
17412025-01-16T20:00:15.604ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
17422025-01-16T20:00:15.604ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 12 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
17432025-01-16T20:00:15.607ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
17442025-01-16T20:00:15.607ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
17452025-01-16T20:00:15.610ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
17462025-01-16T20:00:15.610ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
17472025-01-16T20:00:15.613ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190 sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
17482025-01-16T20:00:15.613ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190
17492025-01-16T20:00:15.620ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190 saga_name = disk-delete sec_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
17502025-01-16T20:00:15.620ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 4e2076f7-03a3-4b84-9492-f0ab45bac190 saga_name = disk-delete saga_result = SagaResult { saga_id: 4e2076f7-03a3-4b84-9492-f0ab45bac190, saga_log: SagaLog { saga_id: 4e2076f7-03a3-4b84-9492-f0ab45bac190, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N006 started, N006 succeeded, N005 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": String("fd440cca-bca6-4b8c-8d5d-e75eba20cebb"), "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("ada4fced-de0a-4ecb-950f-3d3298809a3a"), "name": String("disk-e84f90b1883"), "time_created": String("2025-01-16T19:59:48.352426Z"), "time_deleted": Null, "time_modified": String("2025-01-16T19:59:48.352426Z")}, "pantry_address": Null, "project_id": String("3b7a3701-30a8-4657-a953-08ef3b6f1b29"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2025-01-16T19:59:49.677847Z")}, "size": Number(2147483648), "slot": Null, "volume_id": String("2843f680-659d-476b-ac7e-430cc4908043")}), 1: Succeeded(Null), 2: Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("197fa9bd-2b54-417a-8249-a5354e078485"), "silo_user_id": String("7dece980-441d-4848-943d-fffce58ad417")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("2843f680-659d-476b-ac7e-430cc4908043")}), 3: Succeeded(Null), 4: Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("05042cbd-5b4b-46cc-aa9c-7c8b8c245645"), String("e6942525-1962-4188-8116-cbc30c69a3ff"), String("3bd3c5ef-0997-4225-a470-1cce445ba731")]}}), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Object {"datasets_and_regions": Array [], "volumes": Array []}), 10: Succeeded(Null), 11: Succeeded(Bool(true)), 12: Succeeded(Bool(true)), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Bool(true), node_outputs: {"crucible_resources_to_delete": Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("05042cbd-5b4b-46cc-aa9c-7c8b8c245645"), String("e6942525-1962-4188-8116-cbc30c69a3ff"), String("3bd3c5ef-0997-4225-a470-1cce445ba731")]}}, "deleted_disk": Object {"block_size": String("Traditional"), "create_image_id": String("fd440cca-bca6-4b8c-8d5d-e75eba20cebb"), "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("ada4fced-de0a-4ecb-950f-3d3298809a3a"), "name": String("disk-e84f90b1883"), "time_created": String("2025-01-16T19:59:48.352426Z"), "time_deleted": Null, "time_modified": String("2025-01-16T19:59:48.352426Z")}, "pantry_address": Null, "project_id": String("3b7a3701-30a8-4657-a953-08ef3b6f1b29"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2025-01-16T19:59:49.677847Z")}, "size": Number(2147483648), "slot": Null, "volume_id": String("2843f680-659d-476b-ac7e-430cc4908043")}, "freed_crucible_regions": Object {"datasets_and_regions": Array [], "volumes": Array []}, "no_result1": Null, "no_result_1": Null, "no_result_2": Null, "no_result_3": Null, "no_result_4": Null, "no_result_5": Null, "params_for_volume_delete_subsaga": Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("197fa9bd-2b54-417a-8249-a5354e078485"), "silo_user_id": String("7dece980-441d-4848-943d-fffce58ad417")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("2843f680-659d-476b-ac7e-430cc4908043")}, "volume_delete_subsaga_no_result": Bool(true), "volume_hard_deleted": Bool(true)} }) }
17512025-01-16T20:00:15.620ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 582541 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 6ea8054f-d641-4195-b6df-6e93f7acc3fa response_code = 204 uri = /v1/disks/disk-e84f90b1883?project=proj-1279a041a9e
17522025-01-16T20:00:15.621ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17532025-01-16T20:00:15.622ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17542025-01-16T20:00:15.623ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17552025-01-16T20:00:15.623ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17562025-01-16T20:00:15.624ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
17572025-01-16T20:00:15.626ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("token = \\"9fc7fee85a0620a9929e974a7fc00e15c0f6724d\\"") } result = Ok(())
17582025-01-16T20:00:15.626ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17592025-01-16T20:00:15.626ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17602025-01-16T20:00:15.627ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17612025-01-16T20:00:15.627ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17622025-01-16T20:00:15.629ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17632025-01-16T20:00:15.629ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17642025-01-16T20:00:15.630ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17652025-01-16T20:00:15.630ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17662025-01-16T20:00:15.632ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
17672025-01-16T20:00:15.633ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
17682025-01-16T20:00:15.633ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17692025-01-16T20:00:15.633ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17702025-01-16T20:00:15.635ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
17712025-01-16T20:00:15.636ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("9fc7fee85a0620a9929e974a7fc00e15c0f6724d") } result = Ok(())
17722025-01-16T20:00:15.636ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17732025-01-16T20:00:15.636ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17742025-01-16T20:00:15.641ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17752025-01-16T20:00:15.641ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17762025-01-16T20:00:15.642ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17772025-01-16T20:00:15.642ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17782025-01-16T20:00:15.644ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17792025-01-16T20:00:15.644ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17802025-01-16T20:00:15.645ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17812025-01-16T20:00:15.645ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17822025-01-16T20:00:15.647ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
17832025-01-16T20:00:15.648ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
17842025-01-16T20:00:15.648ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17852025-01-16T20:00:15.648ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17862025-01-16T20:00:15.649ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17872025-01-16T20:00:15.649ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17882025-01-16T20:00:15.650ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17892025-01-16T20:00:15.650ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17902025-01-16T20:00:15.652ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
17912025-01-16T20:00:15.653ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) } result = Ok(())
17922025-01-16T20:00:15.653ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
17932025-01-16T20:00:15.653ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
17942025-01-16T20:00:15.654ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
17952025-01-16T20:00:15.654ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
17962025-01-16T20:00:15.655ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
17972025-01-16T20:00:15.656ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
17982025-01-16T20:00:15.657ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
17992025-01-16T20:00:15.658ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18002025-01-16T20:00:15.659ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18012025-01-16T20:00:15.659ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18022025-01-16T20:00:15.662ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18032025-01-16T20:00:15.662ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18042025-01-16T20:00:15.664ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18052025-01-16T20:00:15.664ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18062025-01-16T20:00:15.666ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18072025-01-16T20:00:15.667ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18082025-01-16T20:00:15.668ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18092025-01-16T20:00:15.671ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: eb55f5f5-2a4c-40c2-bd34-239e3ac14b29, lookup_type: ByName("default") }, key: 1aa6415f-8de3-4670-80a6-8c581a5eca1a, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18102025-01-16T20:00:15.671ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18112025-01-16T20:00:15.672ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18122025-01-16T20:00:15.674ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18132025-01-16T20:00:15.674ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18142025-01-16T20:00:15.676ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18152025-01-16T20:00:15.676ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18162025-01-16T20:00:15.678ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18172025-01-16T20:00:15.679ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18182025-01-16T20:00:15.681ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18192025-01-16T20:00:15.684ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: eb55f5f5-2a4c-40c2-bd34-239e3ac14b29, lookup_type: ByName("default") }, key: 1aa6415f-8de3-4670-80a6-8c581a5eca1a, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18202025-01-16T20:00:15.684ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18212025-01-16T20:00:15.684ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18222025-01-16T20:00:15.686ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18232025-01-16T20:00:15.687ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18242025-01-16T20:00:15.691ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18252025-01-16T20:00:15.691ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18262025-01-16T20:00:15.738ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18272025-01-16T20:00:15.738ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18282025-01-16T20:00:15.743ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121457 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 4517ea4f-f8ec-4c7b-b944-12aed096e9f2 response_code = 204 uri = /v1/vpc-subnets/default?project=proj-1279a041a9e&vpc=default
18292025-01-16T20:00:15.743ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
18302025-01-16T20:00:15.743ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18312025-01-16T20:00:15.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18322025-01-16T20:00:15.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18332025-01-16T20:00:15.744ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
18342025-01-16T20:00:15.744ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
18352025-01-16T20:00:15.745ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18362025-01-16T20:00:15.745ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
18372025-01-16T20:00:15.745ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
18382025-01-16T20:00:15.746ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18392025-01-16T20:00:15.746ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18402025-01-16T20:00:15.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18412025-01-16T20:00:15.747ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
18422025-01-16T20:00:15.748ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18432025-01-16T20:00:15.748ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("token = \\"9fc7fee85a0620a9929e974a7fc00e15c0f6724d\\"") } result = Ok(())
18442025-01-16T20:00:15.748ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
18452025-01-16T20:00:15.749ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
18462025-01-16T20:00:15.749ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18472025-01-16T20:00:15.749ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18482025-01-16T20:00:15.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18492025-01-16T20:00:15.750ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
18502025-01-16T20:00:15.750ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
18512025-01-16T20:00:15.751ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
18522025-01-16T20:00:15.751ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
18532025-01-16T20:00:15.753ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
18542025-01-16T20:00:15.753ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
18552025-01-16T20:00:15.754ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
18562025-01-16T20:00:15.756ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
18572025-01-16T20:00:15.756ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
18582025-01-16T20:00:15.756ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
18592025-01-16T20:00:15.757ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
18602025-01-16T20:00:15.759ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("9fc7fee85a0620a9929e974a7fc00e15c0f6724d") } result = Ok(())
18612025-01-16T20:00:15.759ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
18622025-01-16T20:00:15.759ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
18632025-01-16T20:00:15.783ZINFOnexus (BackgroundTasks): VPC route manager sled 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
18642025-01-16T20:00:15.783ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18652025-01-16T20:00:15.784ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "44e5e3f6-99a7-434b-b837-311f1b4e272c", "content-length": "372", "date": "Thu, 16 Jan 2025 20:00:15 GMT"} })
18662025-01-16T20:00:15.784ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18672025-01-16T20:00:15.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18682025-01-16T20:00:15.788ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
18692025-01-16T20:00:15.788ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
18702025-01-16T20:00:15.790ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
18712025-01-16T20:00:15.790ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
18722025-01-16T20:00:15.791ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
18732025-01-16T20:00:15.792ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
18742025-01-16T20:00:15.793ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
18752025-01-16T20:00:15.793ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
18762025-01-16T20:00:15.794ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
18772025-01-16T20:00:15.796ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
18782025-01-16T20:00:15.796ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
18792025-01-16T20:00:15.796ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
18802025-01-16T20:00:15.797ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
18812025-01-16T20:00:15.798ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
18822025-01-16T20:00:15.798ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
18832025-01-16T20:00:15.798ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
18842025-01-16T20:00:15.798ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3a378e1d-f157-4d4c-9d9e-e23ce1fa9a39", "date": "Thu, 16 Jan 2025 20:00:15 GMT"} })
18852025-01-16T20:00:15.798ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18862025-01-16T20:00:15.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18872025-01-16T20:00:15.799ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
18882025-01-16T20:00:15.799ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
18892025-01-16T20:00:15.800ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18902025-01-16T20:00:15.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18912025-01-16T20:00:15.800ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
18922025-01-16T20:00:15.801ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) } result = Ok(())
18932025-01-16T20:00:15.801ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
18942025-01-16T20:00:15.802ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
18952025-01-16T20:00:15.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18962025-01-16T20:00:15.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18972025-01-16T20:00:15.803ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
18982025-01-16T20:00:15.803ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
18992025-01-16T20:00:15.804ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19002025-01-16T20:00:15.804ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19012025-01-16T20:00:15.805ZINFOnexus (BackgroundTasks): VPC route manager sled 87207105-a825-4eaa-ac6d-6aaa586b0fc5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
19022025-01-16T20:00:15.805ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19032025-01-16T20:00:15.805ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b789e9ef-9be2-4211-8d87-aa624e50a0ce", "date": "Thu, 16 Jan 2025 20:00:15 GMT"} })
19042025-01-16T20:00:15.806ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19052025-01-16T20:00:15.806ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19062025-01-16T20:00:15.807ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 64.060994ms iteration = 27 status = {}
19072025-01-16T20:00:15.808ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19082025-01-16T20:00:15.808ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19092025-01-16T20:00:15.810ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19102025-01-16T20:00:15.810ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19112025-01-16T20:00:15.812ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19122025-01-16T20:00:15.812ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19132025-01-16T20:00:15.815ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19142025-01-16T20:00:15.818ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: eb55f5f5-2a4c-40c2-bd34-239e3ac14b29, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19152025-01-16T20:00:15.818ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19162025-01-16T20:00:15.818ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19172025-01-16T20:00:15.820ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19182025-01-16T20:00:15.820ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19192025-01-16T20:00:15.823ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19202025-01-16T20:00:15.823ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19212025-01-16T20:00:15.824ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19222025-01-16T20:00:15.824ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19232025-01-16T20:00:15.827ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19242025-01-16T20:00:15.829ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: eb55f5f5-2a4c-40c2-bd34-239e3ac14b29, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19252025-01-16T20:00:15.829ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19262025-01-16T20:00:15.829ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19272025-01-16T20:00:15.831ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19282025-01-16T20:00:15.831ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19292025-01-16T20:00:15.835ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19302025-01-16T20:00:15.836ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19312025-01-16T20:00:15.838ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19322025-01-16T20:00:15.838ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19332025-01-16T20:00:15.839ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19342025-01-16T20:00:15.840ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19352025-01-16T20:00:15.842ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19362025-01-16T20:00:15.842ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19372025-01-16T20:00:15.844ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19382025-01-16T20:00:15.847ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: eb55f5f5-2a4c-40c2-bd34-239e3ac14b29, lookup_type: ByName("default") }, key: 57674ec8-e0a3-42f1-8d16-6c90c0eabaad, lookup_type: ById(57674ec8-e0a3-42f1-8d16-6c90c0eabaad) } result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19392025-01-16T20:00:15.847ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19402025-01-16T20:00:15.847ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19412025-01-16T20:00:15.851ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19422025-01-16T20:00:15.851ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19432025-01-16T20:00:15.855ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19442025-01-16T20:00:15.855ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19452025-01-16T20:00:15.857ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19462025-01-16T20:00:15.858ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19472025-01-16T20:00:15.860ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19482025-01-16T20:00:15.860ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19492025-01-16T20:00:15.862ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19502025-01-16T20:00:15.862ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19512025-01-16T20:00:15.865ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19522025-01-16T20:00:15.865ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19532025-01-16T20:00:15.867ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19542025-01-16T20:00:15.869ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") }, key: eb55f5f5-2a4c-40c2-bd34-239e3ac14b29, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19552025-01-16T20:00:15.869ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-1279a041a9e
19562025-01-16T20:00:15.869ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-1279a041a9e
19572025-01-16T20:00:15.880ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136004 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 849288d8-194d-4972-9d5b-dc4538ce00a1 response_code = 204 uri = /v1/vpcs/default?project=proj-1279a041a9e
19582025-01-16T20:00:15.880ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
19592025-01-16T20:00:15.881ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
19602025-01-16T20:00:15.882ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
19612025-01-16T20:00:15.882ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
19622025-01-16T20:00:15.883ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
19632025-01-16T20:00:15.884ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("token = \\"9fc7fee85a0620a9929e974a7fc00e15c0f6724d\\"") } result = Ok(())
19642025-01-16T20:00:15.884ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
19652025-01-16T20:00:15.884ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
19662025-01-16T20:00:15.885ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
19672025-01-16T20:00:15.886ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
19682025-01-16T20:00:15.887ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
19692025-01-16T20:00:15.887ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
19702025-01-16T20:00:15.888ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
19712025-01-16T20:00:15.888ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
19722025-01-16T20:00:15.890ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
19732025-01-16T20:00:15.891ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
19742025-01-16T20:00:15.891ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
19752025-01-16T20:00:15.891ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
19762025-01-16T20:00:15.893ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
19772025-01-16T20:00:15.893ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "9fc7fee85a0620a9929e974a7fc00e15c0f6724d", lookup_type: ByCompositeId("9fc7fee85a0620a9929e974a7fc00e15c0f6724d") } result = Ok(())
19782025-01-16T20:00:15.893ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
19792025-01-16T20:00:15.894ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
19802025-01-16T20:00:15.898ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
19812025-01-16T20:00:15.898ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
19822025-01-16T20:00:15.900ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
19832025-01-16T20:00:15.900ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
19842025-01-16T20:00:15.901ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
19852025-01-16T20:00:15.901ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
19862025-01-16T20:00:15.902ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
19872025-01-16T20:00:15.903ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
19882025-01-16T20:00:15.904ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
19892025-01-16T20:00:15.905ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 7dece980-441d-4848-943d-fffce58ad417, lookup_type: ById(7dece980-441d-4848-943d-fffce58ad417) } result = Ok(())
19902025-01-16T20:00:15.905ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
19912025-01-16T20:00:15.905ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
19922025-01-16T20:00:15.906ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
19932025-01-16T20:00:15.906ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
19942025-01-16T20:00:15.908ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
19952025-01-16T20:00:15.908ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
19962025-01-16T20:00:15.909ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
19972025-01-16T20:00:15.910ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) } result = Ok(())
19982025-01-16T20:00:15.910ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 roles = RoleSet { roles: {} } uri = /v1/projects/proj-1279a041a9e
19992025-01-16T20:00:15.910ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 resource = Database result = Ok(()) uri = /v1/projects/proj-1279a041a9e
20002025-01-16T20:00:15.911ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 roles = RoleSet { roles: {} } uri = /v1/projects/proj-1279a041a9e
20012025-01-16T20:00:15.911ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 resource = Database result = Ok(()) uri = /v1/projects/proj-1279a041a9e
20022025-01-16T20:00:15.912ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 roles = RoleSet { roles: {} } uri = /v1/projects/proj-1279a041a9e
20032025-01-16T20:00:15.913ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 resource = Database result = Ok(()) uri = /v1/projects/proj-1279a041a9e
20042025-01-16T20:00:15.915ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 roles = RoleSet { roles: {} } uri = /v1/projects/proj-1279a041a9e
20052025-01-16T20:00:15.915ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 resource = Database result = Ok(()) uri = /v1/projects/proj-1279a041a9e
20062025-01-16T20:00:15.918ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 roles = RoleSet { roles: {} } uri = /v1/projects/proj-1279a041a9e
20072025-01-16T20:00:15.918ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 resource = Database result = Ok(()) uri = /v1/projects/proj-1279a041a9e
20082025-01-16T20:00:15.920ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 roles = RoleSet { roles: {} } uri = /v1/projects/proj-1279a041a9e
20092025-01-16T20:00:15.920ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 resource = Database result = Ok(()) uri = /v1/projects/proj-1279a041a9e
20102025-01-16T20:00:15.922ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/projects/proj-1279a041a9e
20112025-01-16T20:00:15.924ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 resource = Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") } result = Ok(()) uri = /v1/projects/proj-1279a041a9e
20122025-01-16T20:00:15.924ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 roles = RoleSet { roles: {} } uri = /v1/projects/proj-1279a041a9e
20132025-01-16T20:00:15.924ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 resource = Database result = Ok(()) uri = /v1/projects/proj-1279a041a9e
20142025-01-16T20:00:15.926ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 roles = RoleSet { roles: {} } uri = /v1/projects/proj-1279a041a9e
20152025-01-16T20:00:15.926ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 resource = Database result = Ok(()) uri = /v1/projects/proj-1279a041a9e
20162025-01-16T20:00:15.928ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 roles = RoleSet { roles: {} } uri = /v1/projects/proj-1279a041a9e
20172025-01-16T20:00:15.928ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 resource = Database result = Ok(()) uri = /v1/projects/proj-1279a041a9e
20182025-01-16T20:00:15.931ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 roles = RoleSet { roles: {} } uri = /v1/projects/proj-1279a041a9e
20192025-01-16T20:00:15.931ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 resource = Database result = Ok(()) uri = /v1/projects/proj-1279a041a9e
20202025-01-16T20:00:15.933ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 roles = RoleSet { roles: {(Silo, 197fa9bd-2b54-417a-8249-a5354e078485, "admin")} } uri = /v1/projects/proj-1279a041a9e
20212025-01-16T20:00:15.935ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 resource = Project { parent: Silo { parent: Fleet, key: 197fa9bd-2b54-417a-8249-a5354e078485, lookup_type: ById(197fa9bd-2b54-417a-8249-a5354e078485) }, key: 3b7a3701-30a8-4657-a953-08ef3b6f1b29, lookup_type: ByName("proj-1279a041a9e") } result = Ok(()) uri = /v1/projects/proj-1279a041a9e
20222025-01-16T20:00:15.935ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 roles = RoleSet { roles: {} } uri = /v1/projects/proj-1279a041a9e
20232025-01-16T20:00:15.935ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 resource = Database result = Ok(()) uri = /v1/projects/proj-1279a041a9e
20242025-01-16T20:00:15.937ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 roles = RoleSet { roles: {} } uri = /v1/projects/proj-1279a041a9e
20252025-01-16T20:00:15.937ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 resource = Database result = Ok(()) uri = /v1/projects/proj-1279a041a9e
20262025-01-16T20:00:15.939ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 roles = RoleSet { roles: {} } uri = /v1/projects/proj-1279a041a9e
20272025-01-16T20:00:15.940ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 resource = Database result = Ok(()) uri = /v1/projects/proj-1279a041a9e
20282025-01-16T20:00:15.950ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 roles = RoleSet { roles: {} } uri = /v1/projects/proj-1279a041a9e
20292025-01-16T20:00:15.950ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 resource = Database result = Ok(()) uri = /v1/projects/proj-1279a041a9e
20302025-01-16T20:00:15.958ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 roles = RoleSet { roles: {} } uri = /v1/projects/proj-1279a041a9e
20312025-01-16T20:00:15.958ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 resource = Database result = Ok(()) uri = /v1/projects/proj-1279a041a9e
20322025-01-16T20:00:15.960ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 roles = RoleSet { roles: {} } uri = /v1/projects/proj-1279a041a9e
20332025-01-16T20:00:15.960ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 resource = Database result = Ok(()) uri = /v1/projects/proj-1279a041a9e
20342025-01-16T20:00:15.962ZDEBGnexus (dropshot_external): roles actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 roles = RoleSet { roles: {} } uri = /v1/projects/proj-1279a041a9e
20352025-01-16T20:00:15.962ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 7dece980-441d-4848-943d-fffce58ad417, silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, .. }) actor_id = 7dece980-441d-4848-943d-fffce58ad417 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 resource = Database result = Ok(()) uri = /v1/projects/proj-1279a041a9e
20362025-01-16T20:00:15.971ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90470 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:49716 req_id = 0d005481-68c8-44a7-b0dd-19d42fd0c492 response_code = 204 uri = /v1/projects/proj-1279a041a9e
20372025-01-16T20:00:22.683ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:49474 method = GET remote_addr = [fd00:1122:3344:101::d]:39316 req_id = b20c5160-22ba-491e-bdcd-cae0c8de82ad response_code = 200 uri = /3c6582d4-0e42-407f-bc66-e913ef1c0f57
20382025-01-16T20:00:22.837ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
20392025-01-16T20:00:22.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20402025-01-16T20:00:22.837ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
20412025-01-16T20:00:22.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20422025-01-16T20:00:22.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20432025-01-16T20:00:22.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20442025-01-16T20:00:22.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20452025-01-16T20:00:22.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20462025-01-16T20:00:22.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20472025-01-16T20:00:22.841ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.670925ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20482025-01-16T20:00:22.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20492025-01-16T20:00:22.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20502025-01-16T20:00:22.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20512025-01-16T20:00:22.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20522025-01-16T20:00:22.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20532025-01-16T20:00:22.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20542025-01-16T20:00:22.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 39de0ab7-8c61-46aa-88f2-d42db34dffb8, lookup_type: ById(39de0ab7-8c61-46aa-88f2-d42db34dffb8) } result = Ok(())
20552025-01-16T20:00:22.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20562025-01-16T20:00:22.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20572025-01-16T20:00:22.857ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 original_time_created = 2025-01-16 19:48:51.140214 UTC target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 time_created = 2025-01-16 19:48:51.140214 UTC
20582025-01-16T20:00:22.857ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.92362ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"39de0ab7-8c61-46aa-88f2-d42db34dffb8","time_created":"2025-01-16T19:48:51.140214Z"}
20592025-01-16T20:00:27.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 2b4efb3e-7016-4182-8eaf-e1718b51666a roles = RoleSet { roles: {} } uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?sort_by=id_ascending
20602025-01-16T20:00:27.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 2b4efb3e-7016-4182-8eaf-e1718b51666a resource = Database result = Ok(()) uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?sort_by=id_ascending
20612025-01-16T20:00:27.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 2b4efb3e-7016-4182-8eaf-e1718b51666a response_code = 200 uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?sort_by=id_ascending
20622025-01-16T20:00:27.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = c42fac62-b41d-4e44-b59c-2ef7d9617184 roles = RoleSet { roles: {} } uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWFjMTliZS0yMzc3LTQyMDItYmQzYS0xNjEyMjBiMjRkNDAifX0%3D
20632025-01-16T20:00:27.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = c42fac62-b41d-4e44-b59c-2ef7d9617184 resource = Database result = Ok(()) uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWFjMTliZS0yMzc3LTQyMDItYmQzYS0xNjEyMjBiMjRkNDAifX0%3D
20642025-01-16T20:00:27.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2720 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = c42fac62-b41d-4e44-b59c-2ef7d9617184 response_code = 200 uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWFjMTliZS0yMzc3LTQyMDItYmQzYS0xNjEyMjBiMjRkNDAifX0%3D
20652025-01-16T20:00:32.684ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::c]:49474 method = GET remote_addr = [fd00:1122:3344:101::d]:39316 req_id = 6ba0991c-431c-4455-8b0f-f38670333358 response_code = 200 uri = /3c6582d4-0e42-407f-bc66-e913ef1c0f57
20662025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
20672025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20682025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
20692025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
20702025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
20712025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20722025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
20732025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
20742025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
20752025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20762025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
20772025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
20782025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
20792025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
20802025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20812025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
20822025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
20832025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20842025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20852025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
20862025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20872025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
20882025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20892025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
20902025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
20912025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
20922025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20932025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
20942025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
20952025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20962025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
20972025-01-16T20:00:32.837ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
20982025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
20992025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21002025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21012025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
21022025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21032025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21042025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
21052025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
21062025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21072025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
21082025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21092025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21102025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21112025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21122025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21132025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21142025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
21152025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21162025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21172025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
21182025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21192025-01-16T20:00:32.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21202025-01-16T20:00:32.839ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21212025-01-16T20:00:32.840ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.246927ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
21222025-01-16T20:00:32.840ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.533932ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
21232025-01-16T20:00:32.841ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21242025-01-16T20:00:32.841ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.150823ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
21252025-01-16T20:00:32.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
21262025-01-16T20:00:32.841ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21272025-01-16T20:00:32.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21282025-01-16T20:00:32.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21292025-01-16T20:00:32.842ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1591, tv_nsec: 75101658 } })
21302025-01-16T20:00:32.842ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
21312025-01-16T20:00:32.842ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1591, tv_nsec: 75801801 } })
21322025-01-16T20:00:32.843ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
21332025-01-16T20:00:32.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21342025-01-16T20:00:32.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21352025-01-16T20:00:32.844ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21362025-01-16T20:00:32.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21372025-01-16T20:00:32.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21382025-01-16T20:00:32.846ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21392025-01-16T20:00:32.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21402025-01-16T20:00:32.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
21412025-01-16T20:00:32.847ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
21422025-01-16T20:00:32.847ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21432025-01-16T20:00:32.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21442025-01-16T20:00:32.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21452025-01-16T20:00:32.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21462025-01-16T20:00:32.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21472025-01-16T20:00:32.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21482025-01-16T20:00:32.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21492025-01-16T20:00:32.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21502025-01-16T20:00:32.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21512025-01-16T20:00:32.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.750429ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21522025-01-16T20:00:32.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
21532025-01-16T20:00:32.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21542025-01-16T20:00:32.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
21552025-01-16T20:00:32.852ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1591, tv_nsec: 85589882 } })
21562025-01-16T20:00:32.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21572025-01-16T20:00:32.853ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f
21582025-01-16T20:00:32.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21592025-01-16T20:00:32.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21602025-01-16T20:00:32.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
21612025-01-16T20:00:32.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21622025-01-16T20:00:32.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21632025-01-16T20:00:32.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21642025-01-16T20:00:32.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21652025-01-16T20:00:32.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21662025-01-16T20:00:32.858ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21672025-01-16T20:00:32.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21682025-01-16T20:00:32.871ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21692025-01-16T20:00:32.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21702025-01-16T20:00:32.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21712025-01-16T20:00:32.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21722025-01-16T20:00:32.885ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21732025-01-16T20:00:32.887ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
21742025-01-16T20:00:32.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
21752025-01-16T20:00:32.888ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21762025-01-16T20:00:32.888ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21772025-01-16T20:00:32.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21782025-01-16T20:00:32.889ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21792025-01-16T20:00:32.889ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
21802025-01-16T20:00:32.889ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21812025-01-16T20:00:32.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21822025-01-16T20:00:32.892ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21832025-01-16T20:00:32.893ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21842025-01-16T20:00:32.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21852025-01-16T20:00:32.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21862025-01-16T20:00:32.894ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21872025-01-16T20:00:32.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21882025-01-16T20:00:32.895ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
21892025-01-16T20:00:32.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21902025-01-16T20:00:32.897ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21912025-01-16T20:00:32.897ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
21922025-01-16T20:00:32.897ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21932025-01-16T20:00:32.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21942025-01-16T20:00:32.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21952025-01-16T20:00:32.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 65.801175ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21962025-01-16T20:00:32.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 39de0ab7-8c61-46aa-88f2-d42db34dffb8, lookup_type: ById(39de0ab7-8c61-46aa-88f2-d42db34dffb8) } result = Ok(())
21972025-01-16T20:00:32.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21982025-01-16T20:00:32.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21992025-01-16T20:00:32.904ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
22002025-01-16T20:00:32.904ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.827512ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
22012025-01-16T20:00:32.914ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22022025-01-16T20:00:32.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22032025-01-16T20:00:32.935ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 97.937409ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
22042025-01-16T20:00:32.935ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22052025-01-16T20:00:32.938ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
22062025-01-16T20:00:32.938ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22072025-01-16T20:00:32.938ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 87207105-a825-4eaa-ac6d-6aaa586b0fc5, lookup_type: ById(87207105-a825-4eaa-ac6d-6aaa586b0fc5) } result = Ok(())
22082025-01-16T20:00:32.938ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22092025-01-16T20:00:32.938ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdf136ef-5870-42f8-8f79-30a1a026c0fd", "content-length": "26", "date": "Thu, 16 Jan 2025 20:00:32 GMT"} })
22102025-01-16T20:00:32.938ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22112025-01-16T20:00:32.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22122025-01-16T20:00:32.940ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22132025-01-16T20:00:32.946ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
22142025-01-16T20:00:32.946ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22152025-01-16T20:00:32.946ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 108.954142ms iteration = 27 status = {"physical_disks_added":0}
22162025-01-16T20:00:32.946ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "479f318c-aa94-44a1-a155-091369734e80", "content-length": "26", "date": "Thu, 16 Jan 2025 20:00:32 GMT"} })
22172025-01-16T20:00:32.946ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22182025-01-16T20:00:32.948ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22192025-01-16T20:00:32.957ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22202025-01-16T20:00:32.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22212025-01-16T20:00:32.962ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f zone_address = fd00:1122:3344:101::2
22222025-01-16T20:00:32.962ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22232025-01-16T20:00:32.963ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "425bef29-2524-494f-9a94-be20fd56c262", "content-length": "26", "date": "Thu, 16 Jan 2025 20:00:32 GMT"} })
22242025-01-16T20:00:32.963ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22252025-01-16T20:00:32.964ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 26dc04a7-8537-47d8-965d-0931849f651f
22262025-01-16T20:00:33.000ZINFOnexus (BackgroundTasks): VPC route manager sled 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
22272025-01-16T20:00:33.000ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22282025-01-16T20:00:33.002ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22292025-01-16T20:00:33.004ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 166.896169ms iteration = 24 status = 0
22302025-01-16T20:00:33.004ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
22312025-01-16T20:00:33.004ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
22322025-01-16T20:00:33.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
22332025-01-16T20:00:33.014ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 original_time_created = 2025-01-16 19:48:51.140214 UTC target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 time_created = 2025-01-16 19:48:51.140214 UTC
22342025-01-16T20:00:33.014ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 177.085457ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"39de0ab7-8c61-46aa-88f2-d42db34dffb8","time_created":"2025-01-16T19:48:51.140214Z"}
22352025-01-16T20:00:33.039ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22362025-01-16T20:00:33.039ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 202.155177ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
22372025-01-16T20:00:33.039ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
22382025-01-16T20:00:33.039ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 202.095157ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
22392025-01-16T20:00:33.042ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
22402025-01-16T20:00:33.042ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 205.149489ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
22412025-01-16T20:00:33.043ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
22422025-01-16T20:00:33.043ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5de66c26-f174-4b81-a864-8d25d89b1237", "content-length": "2", "date": "Thu, 16 Jan 2025 20:00:32 GMT"} })
22432025-01-16T20:00:33.045ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22442025-01-16T20:00:33.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22452025-01-16T20:00:33.048ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 210.86925ms iteration = 24 status = null
22462025-01-16T20:00:33.052ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 215.114004ms iteration = 24 status = {}
22472025-01-16T20:00:33.093ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22482025-01-16T20:00:33.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22492025-01-16T20:00:33.097ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7d70241-e4b3-45c3-b315-4f931987ac86", "content-length": "372", "date": "Thu, 16 Jan 2025 20:00:32 GMT"} })
22502025-01-16T20:00:33.097ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22512025-01-16T20:00:33.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22522025-01-16T20:00:33.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22532025-01-16T20:00:33.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22542025-01-16T20:00:33.114ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 6ec20bf0-03fa-4e36-9de7-54dd5e9cfde1, rack_id: 26dc04a7-8537-47d8-965d-0931849f651f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(438946af-d2bd-4eab-8036-57fe8293b9f9) } rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch_location = Switch0
22552025-01-16T20:00:33.115ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22562025-01-16T20:00:33.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22572025-01-16T20:00:33.122ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22582025-01-16T20:00:33.123ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22592025-01-16T20:00:33.123ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22602025-01-16T20:00:33.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22612025-01-16T20:00:33.124ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
22622025-01-16T20:00:33.125ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7966b5a6-7ee6-4d15-a08f-b031e4870494", "content-length": "134", "date": "Thu, 16 Jan 2025 20:00:32 GMT"} })
22632025-01-16T20:00:33.125ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
22642025-01-16T20:00:33.125ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 438946af-d2bd-4eab-8036-57fe8293b9f9
22652025-01-16T20:00:33.125ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
22662025-01-16T20:00:33.125ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
22672025-01-16T20:00:33.125ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22682025-01-16T20:00:33.125ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22692025-01-16T20:00:33.125ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22702025-01-16T20:00:33.125ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22712025-01-16T20:00:33.125ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22722025-01-16T20:00:33.125ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22732025-01-16T20:00:33.125ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f
22742025-01-16T20:00:33.125ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22752025-01-16T20:00:33.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22762025-01-16T20:00:33.128ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
22772025-01-16T20:00:33.128ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b575180-66c1-4ad4-9398-b834afd710d6", "content-length": "2", "date": "Thu, 16 Jan 2025 20:00:32 GMT"} })
22782025-01-16T20:00:33.128ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
22792025-01-16T20:00:33.128ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d15e72f-f84d-4e70-ac02-c4f947eea9b9", "content-length": "52", "date": "Thu, 16 Jan 2025 20:00:32 GMT"} })
22802025-01-16T20:00:33.128ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch_location = Switch0
22812025-01-16T20:00:33.128ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
22822025-01-16T20:00:33.139ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
22832025-01-16T20:00:33.139ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
22842025-01-16T20:00:33.152ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22852025-01-16T20:00:33.153ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22862025-01-16T20:00:33.153ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22872025-01-16T20:00:33.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22882025-01-16T20:00:33.187ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
22892025-01-16T20:00:33.222ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f0e1405c-abbd-4f46-afdf-924b78d62351", "date": "Thu, 16 Jan 2025 20:00:32 GMT"} })
22902025-01-16T20:00:33.222ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch = Switch0
22912025-01-16T20:00:33.222ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
22922025-01-16T20:00:33.222ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e28de3a5-59bc-4460-892d-2ead2134e34a", "date": "Thu, 16 Jan 2025 20:00:32 GMT"} })
22932025-01-16T20:00:33.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22942025-01-16T20:00:33.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22952025-01-16T20:00:33.222ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "77ebf411-7065-4825-aee5-26c5f77a86e6", "content-length": "691", "date": "Thu, 16 Jan 2025 20:00:32 GMT"} })
22962025-01-16T20:00:33.222ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8985a75a-8e9a-4c85-a878-8c3b3ccaf704", "content-length": "682", "date": "Thu, 16 Jan 2025 20:00:33 GMT"} })
22972025-01-16T20:00:33.222ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
22982025-01-16T20:00:33.222ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
22992025-01-16T20:00:33.222ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
23002025-01-16T20:00:33.222ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23012025-01-16T20:00:33.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23022025-01-16T20:00:33.225ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 387.611242ms iteration = 26 status = {}
23032025-01-16T20:00:33.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23042025-01-16T20:00:33.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23052025-01-16T20:00:33.226ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23062025-01-16T20:00:33.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23072025-01-16T20:00:33.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23082025-01-16T20:00:33.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23092025-01-16T20:00:33.230ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23102025-01-16T20:00:33.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23112025-01-16T20:00:33.231ZINFOnexus (BackgroundTasks): VPC route manager sled 87207105-a825-4eaa-ac6d-6aaa586b0fc5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
23122025-01-16T20:00:33.231ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23132025-01-16T20:00:33.231ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "296676fe-0e6a-40f9-bcde-b88e111472af", "date": "Thu, 16 Jan 2025 20:00:32 GMT"} })
23142025-01-16T20:00:33.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23152025-01-16T20:00:33.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23162025-01-16T20:00:33.233ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 396.231293ms iteration = 28 status = {}
23172025-01-16T20:00:33.240ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 403.005452ms iteration = 24 status = {}
23182025-01-16T20:00:42.684ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:49474 method = GET remote_addr = [fd00:1122:3344:101::d]:39316 req_id = 879a76ec-2080-4e50-979a-dc1f9e010e4e response_code = 200 uri = /3c6582d4-0e42-407f-bc66-e913ef1c0f57
23192025-01-16T20:00:42.837ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
23202025-01-16T20:00:42.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23212025-01-16T20:00:42.837ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
23222025-01-16T20:00:42.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23232025-01-16T20:00:42.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23242025-01-16T20:00:42.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23252025-01-16T20:00:42.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23262025-01-16T20:00:42.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23272025-01-16T20:00:42.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23282025-01-16T20:00:42.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23292025-01-16T20:00:42.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23302025-01-16T20:00:42.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23312025-01-16T20:00:42.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23322025-01-16T20:00:42.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 39de0ab7-8c61-46aa-88f2-d42db34dffb8, lookup_type: ById(39de0ab7-8c61-46aa-88f2-d42db34dffb8) } result = Ok(())
23332025-01-16T20:00:42.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23342025-01-16T20:00:42.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23352025-01-16T20:00:42.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 original_time_created = 2025-01-16 19:48:51.140214 UTC target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 time_created = 2025-01-16 19:48:51.140214 UTC
23362025-01-16T20:00:42.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.879939ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"39de0ab7-8c61-46aa-88f2-d42db34dffb8","time_created":"2025-01-16T19:48:51.140214Z"}
23372025-01-16T20:00:42.868ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23382025-01-16T20:00:42.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23392025-01-16T20:00:42.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.52313ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23402025-01-16T20:00:52.684ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:49474 method = GET remote_addr = [fd00:1122:3344:101::d]:39316 req_id = 94e4c1a5-b888-4f38-ba79-8dfa1abcac8c response_code = 200 uri = /3c6582d4-0e42-407f-bc66-e913ef1c0f57
23412025-01-16T20:00:52.837ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
23422025-01-16T20:00:52.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23432025-01-16T20:00:52.838ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
23442025-01-16T20:00:52.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23452025-01-16T20:00:52.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23462025-01-16T20:00:52.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23472025-01-16T20:00:52.840ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23482025-01-16T20:00:52.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23492025-01-16T20:00:52.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23502025-01-16T20:00:52.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23512025-01-16T20:00:52.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23522025-01-16T20:00:52.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23532025-01-16T20:00:52.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23542025-01-16T20:00:52.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23552025-01-16T20:00:52.869ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.169917ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23562025-01-16T20:00:52.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23572025-01-16T20:00:52.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 39de0ab7-8c61-46aa-88f2-d42db34dffb8, lookup_type: ById(39de0ab7-8c61-46aa-88f2-d42db34dffb8) } result = Ok(())
23582025-01-16T20:00:52.876ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23592025-01-16T20:00:52.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23602025-01-16T20:00:52.888ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 original_time_created = 2025-01-16 19:48:51.140214 UTC target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 time_created = 2025-01-16 19:48:51.140214 UTC
23612025-01-16T20:00:52.888ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.466526ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"39de0ab7-8c61-46aa-88f2-d42db34dffb8","time_created":"2025-01-16T19:48:51.140214Z"}
23622025-01-16T20:00:57.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 71f40a41-5fa4-4bba-ab12-729c9cb88df0 roles = RoleSet { roles: {} } uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?sort_by=id_ascending
23632025-01-16T20:00:57.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 71f40a41-5fa4-4bba-ab12-729c9cb88df0 resource = Database result = Ok(()) uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?sort_by=id_ascending
23642025-01-16T20:00:57.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 71f40a41-5fa4-4bba-ab12-729c9cb88df0 response_code = 200 uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?sort_by=id_ascending
23652025-01-16T20:00:57.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 68f1dc4b-634f-4c68-bebb-483238bb4ff2 roles = RoleSet { roles: {} } uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWFjMTliZS0yMzc3LTQyMDItYmQzYS0xNjEyMjBiMjRkNDAifX0%3D
23662025-01-16T20:00:57.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 68f1dc4b-634f-4c68-bebb-483238bb4ff2 resource = Database result = Ok(()) uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWFjMTliZS0yMzc3LTQyMDItYmQzYS0xNjEyMjBiMjRkNDAifX0%3D
23672025-01-16T20:00:57.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2640 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 68f1dc4b-634f-4c68-bebb-483238bb4ff2 response_code = 200 uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWFjMTliZS0yMzc3LTQyMDItYmQzYS0xNjEyMjBiMjRkNDAifX0%3D
23682025-01-16T20:01:02.685ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3251 local_addr = [fd00:1122:3344:101::c]:49474 method = GET remote_addr = [fd00:1122:3344:101::d]:39316 req_id = 9ab9160d-175b-4e7c-bf65-2a846253f45b response_code = 200 uri = /3c6582d4-0e42-407f-bc66-e913ef1c0f57
23692025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
23702025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
23712025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23722025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23732025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
23742025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
23752025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
23762025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
23772025-01-16T20:01:02.838ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
23782025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
23792025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23802025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23812025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
23822025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
23832025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23842025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
23852025-01-16T20:01:02.838ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-16 19:51:02.838233745 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
23862025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
23872025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
23882025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
23892025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23902025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
23912025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
23922025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23932025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
23942025-01-16T20:01:02.838ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8
23952025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.411\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"39de0ab7-8c61-46aa-88f2-d42db34dffb8"}
23962025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
23972025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
23982025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23992025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24002025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
24012025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
24022025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
24032025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24042025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
24052025-01-16T20:01:02.838ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
24062025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24072025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
24082025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
24092025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
24102025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24112025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24122025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
24132025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
24142025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
24152025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
24162025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24172025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
24182025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
24192025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
24202025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24212025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
24222025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
24232025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
24242025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
24252025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
24262025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
24272025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24282025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
24292025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24302025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
24312025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24322025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
24332025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
24342025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
24352025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
24362025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24372025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24382025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24392025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24402025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24412025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24422025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24432025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
24442025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24452025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
24462025-01-16T20:01:02.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24472025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24482025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
24492025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24502025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24512025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24522025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24532025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24542025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24552025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
24562025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24572025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
24582025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
24592025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
24602025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24612025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24622025-01-16T20:01:02.839ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1673b82a-d301-40a0-97f5-01c1919bcccc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a78ec168-75b0-4c15-b272-0f34e450b715.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fc5e4155-1b26-42b3-8db4-a4cf6dd61fe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fc5e4155-1b26-42b3-8db4-a4cf6dd61fe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1621, tv_nsec: 71774990 } })
24632025-01-16T20:01:02.839ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("67baed66-640b-413d-8436-22e580c71fff.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b6525081-e08a-4759-918e-50f60ff0f6f1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b6525081-e08a-4759-918e-50f60ff0f6f1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1621, tv_nsec: 71774990 } })
24642025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24652025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24662025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24672025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24682025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24692025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
24702025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
24712025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.412064ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
24722025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
24732025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.15975ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
24742025-01-16T20:01:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
24752025-01-16T20:01:02.841ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1621, tv_nsec: 74102181 } })
24762025-01-16T20:01:02.841ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
24772025-01-16T20:01:02.842ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24782025-01-16T20:01:02.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24792025-01-16T20:01:02.842ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24802025-01-16T20:01:02.842ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24812025-01-16T20:01:02.842ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.521239ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24822025-01-16T20:01:02.845ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24832025-01-16T20:01:02.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24842025-01-16T20:01:02.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24852025-01-16T20:01:02.845ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24862025-01-16T20:01:02.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24872025-01-16T20:01:02.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24882025-01-16T20:01:02.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24892025-01-16T20:01:02.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24902025-01-16T20:01:02.851ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1621, tv_nsec: 84170967 } })
24912025-01-16T20:01:02.851ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
24922025-01-16T20:01:02.851ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24932025-01-16T20:01:02.852ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-16 19:51:02.838233745 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
24942025-01-16T20:01:02.852ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.21778ms iteration = 13 status = {"expiration":"2025-01-16T19:51:02.838233745Z","pruned":[]}
24952025-01-16T20:01:02.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24962025-01-16T20:01:02.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24972025-01-16T20:01:02.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24982025-01-16T20:01:02.854ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24992025-01-16T20:01:02.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25002025-01-16T20:01:02.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
25012025-01-16T20:01:02.856ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
25022025-01-16T20:01:02.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
25032025-01-16T20:01:02.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
25042025-01-16T20:01:02.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25052025-01-16T20:01:02.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25062025-01-16T20:01:02.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25072025-01-16T20:01:02.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25082025-01-16T20:01:02.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25092025-01-16T20:01:02.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25102025-01-16T20:01:02.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25112025-01-16T20:01:02.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25122025-01-16T20:01:02.865ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25132025-01-16T20:01:02.866ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 27.680046ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
25142025-01-16T20:01:02.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25152025-01-16T20:01:02.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
25162025-01-16T20:01:02.867ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
25172025-01-16T20:01:02.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
25182025-01-16T20:01:02.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
25192025-01-16T20:01:02.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25202025-01-16T20:01:02.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25212025-01-16T20:01:02.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25222025-01-16T20:01:02.873ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25232025-01-16T20:01:02.874ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 36.46429ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25242025-01-16T20:01:02.876ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25252025-01-16T20:01:02.876ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25262025-01-16T20:01:02.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25272025-01-16T20:01:02.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25282025-01-16T20:01:02.879ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25292025-01-16T20:01:02.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25302025-01-16T20:01:02.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25312025-01-16T20:01:02.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25322025-01-16T20:01:02.886ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25332025-01-16T20:01:02.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25342025-01-16T20:01:02.890ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.147575ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
25352025-01-16T20:01:02.898ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 60.368859ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
25362025-01-16T20:01:02.900ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
25372025-01-16T20:01:02.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
25382025-01-16T20:01:02.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25392025-01-16T20:01:02.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25402025-01-16T20:01:02.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25412025-01-16T20:01:02.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25422025-01-16T20:01:02.903ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25432025-01-16T20:01:02.903ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
25442025-01-16T20:01:02.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25452025-01-16T20:01:02.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25462025-01-16T20:01:02.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1621, tv_nsec: 137461522 } })
25472025-01-16T20:01:02.904ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25482025-01-16T20:01:02.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f
25492025-01-16T20:01:02.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25502025-01-16T20:01:02.918ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25512025-01-16T20:01:02.919ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
25522025-01-16T20:01:02.919ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
25532025-01-16T20:01:02.919ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 80.885669ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
25542025-01-16T20:01:02.920ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
25552025-01-16T20:01:02.921ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25562025-01-16T20:01:02.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25572025-01-16T20:01:02.921ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25582025-01-16T20:01:02.923ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25592025-01-16T20:01:02.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
25602025-01-16T20:01:02.925ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
25612025-01-16T20:01:02.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
25622025-01-16T20:01:02.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 39de0ab7-8c61-46aa-88f2-d42db34dffb8, lookup_type: ById(39de0ab7-8c61-46aa-88f2-d42db34dffb8) } result = Ok(())
25632025-01-16T20:01:02.926ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25642025-01-16T20:01:02.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25652025-01-16T20:01:02.926ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25662025-01-16T20:01:02.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
25672025-01-16T20:01:02.928ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
25682025-01-16T20:01:02.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
25692025-01-16T20:01:02.928ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25702025-01-16T20:01:02.929ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25712025-01-16T20:01:02.929ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 91.615678ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
25722025-01-16T20:01:02.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
25732025-01-16T20:01:02.930ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
25742025-01-16T20:01:02.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
25752025-01-16T20:01:02.931ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25762025-01-16T20:01:02.933ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
25772025-01-16T20:01:02.933ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
25782025-01-16T20:01:02.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
25792025-01-16T20:01:02.933ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25802025-01-16T20:01:02.933ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
25812025-01-16T20:01:02.933ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
25822025-01-16T20:01:02.933ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
25832025-01-16T20:01:02.933ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25842025-01-16T20:01:02.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25852025-01-16T20:01:02.935ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
25862025-01-16T20:01:02.935ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
25872025-01-16T20:01:02.935ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 96.986391ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
25882025-01-16T20:01:02.935ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
25892025-01-16T20:01:02.935ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
25902025-01-16T20:01:02.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
25912025-01-16T20:01:02.935ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25922025-01-16T20:01:02.935ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25932025-01-16T20:01:02.936ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25942025-01-16T20:01:02.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25952025-01-16T20:01:02.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25962025-01-16T20:01:02.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25972025-01-16T20:01:02.942ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25982025-01-16T20:01:02.942ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 104.411052ms iteration = 6 status = {"nsuccess":5}
25992025-01-16T20:01:02.943ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26002025-01-16T20:01:02.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26012025-01-16T20:01:02.945ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
26022025-01-16T20:01:02.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
26032025-01-16T20:01:02.946ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26042025-01-16T20:01:02.946ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26052025-01-16T20:01:02.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26062025-01-16T20:01:02.947ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 109.122345ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26072025-01-16T20:01:02.948ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26082025-01-16T20:01:02.948ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26092025-01-16T20:01:02.952ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
26102025-01-16T20:01:02.952ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26112025-01-16T20:01:02.952ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 87207105-a825-4eaa-ac6d-6aaa586b0fc5, lookup_type: ById(87207105-a825-4eaa-ac6d-6aaa586b0fc5) } result = Ok(())
26122025-01-16T20:01:02.952ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26132025-01-16T20:01:02.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26142025-01-16T20:01:02.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26152025-01-16T20:01:02.954ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 original_time_created = 2025-01-16 19:48:51.140214 UTC target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 time_created = 2025-01-16 19:48:51.140214 UTC
26162025-01-16T20:01:02.954ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 116.484754ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"39de0ab7-8c61-46aa-88f2-d42db34dffb8","time_created":"2025-01-16T19:48:51.140214Z"}
26172025-01-16T20:01:02.955ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 116.795949ms iteration = 25 status = 0
26182025-01-16T20:01:02.955ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26192025-01-16T20:01:02.958ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26202025-01-16T20:01:02.958ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26212025-01-16T20:01:02.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26222025-01-16T20:01:02.963ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26232025-01-16T20:01:02.963ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
26242025-01-16T20:01:02.963ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26252025-01-16T20:01:02.964ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "95051d4a-c927-484d-a1bb-daa90fc42ef4", "content-length": "26", "date": "Thu, 16 Jan 2025 20:01:02 GMT"} })
26262025-01-16T20:01:02.964ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26272025-01-16T20:01:02.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
26282025-01-16T20:01:02.964ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
26292025-01-16T20:01:02.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
26302025-01-16T20:01:02.970ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26312025-01-16T20:01:02.977ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
26322025-01-16T20:01:02.977ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26332025-01-16T20:01:02.977ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "87e57fdc-7a83-4fd0-a915-fb8582519a8b", "content-length": "26", "date": "Thu, 16 Jan 2025 20:01:02 GMT"} })
26342025-01-16T20:01:02.977ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26352025-01-16T20:01:02.978ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 140.413334ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
26362025-01-16T20:01:02.978ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
26372025-01-16T20:01:02.978ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
26382025-01-16T20:01:02.978ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
26392025-01-16T20:01:02.978ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26402025-01-16T20:01:02.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26412025-01-16T20:01:02.979ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26422025-01-16T20:01:02.979ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
26432025-01-16T20:01:02.979ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26442025-01-16T20:01:02.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26452025-01-16T20:01:02.980ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26462025-01-16T20:01:02.981ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26472025-01-16T20:01:02.984ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26482025-01-16T20:01:02.984ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26492025-01-16T20:01:02.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26502025-01-16T20:01:02.988ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
26512025-01-16T20:01:02.988ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26522025-01-16T20:01:02.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26532025-01-16T20:01:02.990ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
26542025-01-16T20:01:03.000ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
26552025-01-16T20:01:03.000ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 162.159215ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
26562025-01-16T20:01:03.002ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26572025-01-16T20:01:03.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26582025-01-16T20:01:03.005ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26592025-01-16T20:01:03.006ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
26602025-01-16T20:01:03.006ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26612025-01-16T20:01:03.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26622025-01-16T20:01:03.008ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26632025-01-16T20:01:03.008ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
26642025-01-16T20:01:03.008ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f05be43b-5d84-4b95-99be-d6d0a1e3a923 dns_zone_name = oxide.test found_so_far = 0 version = 2
26652025-01-16T20:01:03.008ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26662025-01-16T20:01:03.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26672025-01-16T20:01:03.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26682025-01-16T20:01:03.018ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26692025-01-16T20:01:03.018ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
26702025-01-16T20:01:03.018ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 179.971348ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
26712025-01-16T20:01:03.023ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
26722025-01-16T20:01:03.023ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 481516d2-3f4d-4dc5-9036-8c14a1fa4fd7 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
26732025-01-16T20:01:03.023ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26742025-01-16T20:01:03.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26752025-01-16T20:01:03.027ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 188.818293ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
26762025-01-16T20:01:03.044ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
26772025-01-16T20:01:03.044ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 205.814352ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
26782025-01-16T20:01:03.088ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 250.465735ms iteration = 28 status = {"physical_disks_added":0}
26792025-01-16T20:01:03.183ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f zone_address = fd00:1122:3344:101::2
26802025-01-16T20:01:03.183ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26812025-01-16T20:01:03.183ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7d7fc93-79d4-4e2d-b308-c9a2daad3441", "content-length": "26", "date": "Thu, 16 Jan 2025 20:01:02 GMT"} })
26822025-01-16T20:01:03.183ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26832025-01-16T20:01:03.185ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 26dc04a7-8537-47d8-965d-0931849f651f
26842025-01-16T20:01:03.204ZINFOnexus (BackgroundTasks): VPC route manager sled 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
26852025-01-16T20:01:03.204ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26862025-01-16T20:01:03.207ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26872025-01-16T20:01:03.207ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26882025-01-16T20:01:03.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26892025-01-16T20:01:03.210ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26902025-01-16T20:01:03.210ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
26912025-01-16T20:01:03.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26922025-01-16T20:01:03.210ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "95109e50-4b8a-4b56-ad5f-ec47a813bb0f", "date": "Thu, 16 Jan 2025 20:01:02 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26932025-01-16T20:01:03.210ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26942025-01-16T20:01:03.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26952025-01-16T20:01:03.210ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26962025-01-16T20:01:03.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26972025-01-16T20:01:03.211ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f05be43b-5d84-4b95-99be-d6d0a1e3a923 dns_zone_name = oxide.test found_so_far = 1 version = 2
26982025-01-16T20:01:03.211ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
26992025-01-16T20:01:03.211ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-16 19:49:10.849798 UTC dns_group = external generation = 2
27002025-01-16T20:01:03.211ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 373.617776ms iteration = 14 status = {"generation":2}
27012025-01-16T20:01:03.212ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "1d5715a2-c8ca-41cb-83c4-615a8da0d834", "date": "Thu, 16 Jan 2025 20:01:02 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
27022025-01-16T20:01:03.212ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
27032025-01-16T20:01:03.212ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 481516d2-3f4d-4dc5-9036-8c14a1fa4fd7 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
27042025-01-16T20:01:03.212ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
27052025-01-16T20:01:03.212ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-16 19:49:07.686045 UTC dns_group = internal generation = 1
27062025-01-16T20:01:03.212ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 374.519442ms iteration = 14 status = {"generation":1}
27072025-01-16T20:01:03.214ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
27082025-01-16T20:01:03.214ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 375.996068ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
27092025-01-16T20:01:03.222ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 384.306084ms iteration = 25 status = {}
27102025-01-16T20:01:03.238ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-16T19:48:57.779461Z, time_modified: 2025-01-16T19:48:57.779461Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, db_silo: Silo { identity: SiloIdentity { id: 197fa9bd-2b54-417a-8249-a5354e078485, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T19:49:10.527303Z, time_modified: 2025-01-16T19:49:10.527303Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b24122d5f92c7bd84d282bd8841cee73a1e4d9ad23f30c8a432049fc1b2c4538" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, db_silo: Silo { identity: SiloIdentity { id: 197fa9bd-2b54-417a-8249-a5354e078485, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T19:49:10.527303Z, time_modified: 2025-01-16T19:49:10.527303Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b24122d5f92c7bd84d282bd8841cee73a1e4d9ad23f30c8a432049fc1b2c4538" }] }) }
27112025-01-16T20:01:03.238ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 400.182253ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"197fa9bd-2b54-417a-8249-a5354e078485","tls_certs":["b24122d5f92c7bd84d282bd8841cee73a1e4d9ad23f30c8a432049fc1b2c4538"]}},"default_endpoint":{"silo_id":"197fa9bd-2b54-417a-8249-a5354e078485","tls_certs":["b24122d5f92c7bd84d282bd8841cee73a1e4d9ad23f30c8a432049fc1b2c4538"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
27122025-01-16T20:01:03.245ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9cbf1bc0-da79-49d4-a25e-ed5f72ddea4a", "content-length": "372", "date": "Thu, 16 Jan 2025 20:01:02 GMT"} })
27132025-01-16T20:01:03.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27142025-01-16T20:01:03.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27152025-01-16T20:01:03.269ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
27162025-01-16T20:01:03.280ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
27172025-01-16T20:01:03.280ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bcb2262-9ff3-4876-9dba-97e1cbcefcaa", "content-length": "2", "date": "Thu, 16 Jan 2025 20:01:03 GMT"} })
27182025-01-16T20:01:03.282ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27192025-01-16T20:01:03.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27202025-01-16T20:01:03.285ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 446.950702ms iteration = 25 status = null
27212025-01-16T20:01:03.293ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
27222025-01-16T20:01:03.293ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
27232025-01-16T20:01:03.293ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e3082b43-23cd-4589-9cd3-e302b0d2909f", "date": "Thu, 16 Jan 2025 20:01:03 GMT"} })
27242025-01-16T20:01:03.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27252025-01-16T20:01:03.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27262025-01-16T20:01:03.295ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27272025-01-16T20:01:03.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27282025-01-16T20:01:03.298ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27292025-01-16T20:01:03.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27302025-01-16T20:01:03.301ZINFOnexus (BackgroundTasks): VPC route manager sled 87207105-a825-4eaa-ac6d-6aaa586b0fc5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
27312025-01-16T20:01:03.301ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27322025-01-16T20:01:03.302ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d5462709-6e6a-46ff-9d98-ed38564be5a1", "date": "Thu, 16 Jan 2025 20:01:03 GMT"} })
27332025-01-16T20:01:03.302ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27342025-01-16T20:01:03.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27352025-01-16T20:01:03.304ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 465.978367ms iteration = 29 status = {}
27362025-01-16T20:01:03.331ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27372025-01-16T20:01:03.333ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27382025-01-16T20:01:03.333ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27392025-01-16T20:01:03.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27402025-01-16T20:01:03.335ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27412025-01-16T20:01:03.337ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
27422025-01-16T20:01:03.337ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27432025-01-16T20:01:03.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27442025-01-16T20:01:03.341ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
27452025-01-16T20:01:03.342ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "3fcf26cf-9489-4059-872d-0d4d414d277c", "date": "Thu, 16 Jan 2025 20:01:02 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
27462025-01-16T20:01:03.342ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
27472025-01-16T20:01:03.343ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "db178246-6ffd-4df0-aa94-8a380610970b", "date": "Thu, 16 Jan 2025 20:01:02 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
27482025-01-16T20:01:03.343ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
27492025-01-16T20:01:03.345ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "420332e0-04db-459e-a4f2-9750d85e8d0c", "date": "Thu, 16 Jan 2025 20:01:02 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
27502025-01-16T20:01:03.345ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
27512025-01-16T20:01:03.347ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
27522025-01-16T20:01:03.347ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 509.197875ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
27532025-01-16T20:01:03.380ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27542025-01-16T20:01:03.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27552025-01-16T20:01:03.382ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 6ec20bf0-03fa-4e36-9de7-54dd5e9cfde1, rack_id: 26dc04a7-8537-47d8-965d-0931849f651f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(438946af-d2bd-4eab-8036-57fe8293b9f9) } rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch_location = Switch0
27562025-01-16T20:01:03.382ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27572025-01-16T20:01:03.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27582025-01-16T20:01:03.392ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
27592025-01-16T20:01:03.392ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "96d3147d-fb4a-41cb-84dd-95a180f4030b", "content-length": "134", "date": "Thu, 16 Jan 2025 20:01:03 GMT"} })
27602025-01-16T20:01:03.392ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
27612025-01-16T20:01:03.392ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 438946af-d2bd-4eab-8036-57fe8293b9f9
27622025-01-16T20:01:03.392ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
27632025-01-16T20:01:03.392ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27642025-01-16T20:01:03.392ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27652025-01-16T20:01:03.392ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27662025-01-16T20:01:03.392ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27672025-01-16T20:01:03.392ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27682025-01-16T20:01:03.392ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27692025-01-16T20:01:03.392ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27702025-01-16T20:01:03.393ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f
27712025-01-16T20:01:03.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27722025-01-16T20:01:03.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27732025-01-16T20:01:03.395ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
27742025-01-16T20:01:03.395ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "138f253e-642f-4053-9aa5-7814cf00d17d", "content-length": "2", "date": "Thu, 16 Jan 2025 20:01:03 GMT"} })
27752025-01-16T20:01:03.395ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
27762025-01-16T20:01:03.395ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e359dac-0b4a-4ced-8509-0e58cf819a09", "content-length": "52", "date": "Thu, 16 Jan 2025 20:01:03 GMT"} })
27772025-01-16T20:01:03.395ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch_location = Switch0
27782025-01-16T20:01:03.395ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27792025-01-16T20:01:03.423ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
27802025-01-16T20:01:03.477ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e10c7864-8b7a-40ef-9799-0745ba76bf68", "date": "Thu, 16 Jan 2025 20:01:03 GMT"} })
27812025-01-16T20:01:03.477ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch = Switch0
27822025-01-16T20:01:03.477ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27832025-01-16T20:01:03.477ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b124467-bf46-4b7f-a1f4-7918e2e98aea", "content-length": "691", "date": "Thu, 16 Jan 2025 20:01:03 GMT"} })
27842025-01-16T20:01:03.477ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
27852025-01-16T20:01:03.477ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
27862025-01-16T20:01:03.477ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
27872025-01-16T20:01:03.477ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "69163d95-8bf4-49b6-8927-9bff3583d134", "content-length": "682", "date": "Thu, 16 Jan 2025 20:01:02 GMT"} })
27882025-01-16T20:01:03.477ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27892025-01-16T20:01:03.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27902025-01-16T20:01:03.480ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 641.547587ms iteration = 27 status = {}
27912025-01-16T20:01:03.481ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27922025-01-16T20:01:03.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27932025-01-16T20:01:03.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27942025-01-16T20:01:03.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27952025-01-16T20:01:03.486ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27962025-01-16T20:01:03.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27972025-01-16T20:01:03.494ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 655.762627ms iteration = 25 status = {}
27982025-01-16T20:01:12.684ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:49474 method = GET remote_addr = [fd00:1122:3344:101::d]:39316 req_id = 9bddea2d-71b9-4be9-af09-c517e449886f response_code = 200 uri = /3c6582d4-0e42-407f-bc66-e913ef1c0f57
27992025-01-16T20:01:12.837ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
28002025-01-16T20:01:12.837ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
28012025-01-16T20:01:12.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28022025-01-16T20:01:12.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28032025-01-16T20:01:12.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28042025-01-16T20:01:12.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28052025-01-16T20:01:12.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28062025-01-16T20:01:12.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28072025-01-16T20:01:12.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28082025-01-16T20:01:12.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28092025-01-16T20:01:12.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28102025-01-16T20:01:12.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28112025-01-16T20:01:12.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28122025-01-16T20:01:12.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 39de0ab7-8c61-46aa-88f2-d42db34dffb8, lookup_type: ById(39de0ab7-8c61-46aa-88f2-d42db34dffb8) } result = Ok(())
28132025-01-16T20:01:12.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28142025-01-16T20:01:12.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28152025-01-16T20:01:12.860ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 original_time_created = 2025-01-16 19:48:51.140214 UTC target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 time_created = 2025-01-16 19:48:51.140214 UTC
28162025-01-16T20:01:12.860ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.901872ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"39de0ab7-8c61-46aa-88f2-d42db34dffb8","time_created":"2025-01-16T19:48:51.140214Z"}
28172025-01-16T20:01:12.866ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28182025-01-16T20:01:12.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28192025-01-16T20:01:12.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.225691ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28202025-01-16T20:01:22.684ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::c]:49474 method = GET remote_addr = [fd00:1122:3344:101::d]:39316 req_id = f9aad2f5-1b0c-489f-8dc0-26c7e41c4a1a response_code = 200 uri = /3c6582d4-0e42-407f-bc66-e913ef1c0f57
28212025-01-16T20:01:22.837ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
28222025-01-16T20:01:22.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28232025-01-16T20:01:22.837ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
28242025-01-16T20:01:22.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28252025-01-16T20:01:22.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28262025-01-16T20:01:22.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28272025-01-16T20:01:22.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28282025-01-16T20:01:22.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28292025-01-16T20:01:22.872ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.371563ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28302025-01-16T20:01:22.873ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28312025-01-16T20:01:22.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28322025-01-16T20:01:22.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28332025-01-16T20:01:22.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28342025-01-16T20:01:22.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28352025-01-16T20:01:22.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28362025-01-16T20:01:22.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28372025-01-16T20:01:22.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 39de0ab7-8c61-46aa-88f2-d42db34dffb8, lookup_type: ById(39de0ab7-8c61-46aa-88f2-d42db34dffb8) } result = Ok(())
28382025-01-16T20:01:22.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28392025-01-16T20:01:22.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28402025-01-16T20:01:22.923ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 original_time_created = 2025-01-16 19:48:51.140214 UTC target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 time_created = 2025-01-16 19:48:51.140214 UTC
28412025-01-16T20:01:22.923ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 86.306654ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"39de0ab7-8c61-46aa-88f2-d42db34dffb8","time_created":"2025-01-16T19:48:51.140214Z"}
28422025-01-16T20:01:27.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 8f010f19-9ce2-452d-8033-b28c8c5f620f roles = RoleSet { roles: {} } uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?sort_by=id_ascending
28432025-01-16T20:01:27.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 8f010f19-9ce2-452d-8033-b28c8c5f620f resource = Database result = Ok(()) uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?sort_by=id_ascending
28442025-01-16T20:01:27.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3387 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 8f010f19-9ce2-452d-8033-b28c8c5f620f response_code = 200 uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?sort_by=id_ascending
28452025-01-16T20:01:27.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 16481a0c-3b4c-4dd9-a912-49d7c7ff042d roles = RoleSet { roles: {} } uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWFjMTliZS0yMzc3LTQyMDItYmQzYS0xNjEyMjBiMjRkNDAifX0%3D
28462025-01-16T20:01:27.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 16481a0c-3b4c-4dd9-a912-49d7c7ff042d resource = Database result = Ok(()) uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWFjMTliZS0yMzc3LTQyMDItYmQzYS0xNjEyMjBiMjRkNDAifX0%3D
28472025-01-16T20:01:27.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 16481a0c-3b4c-4dd9-a912-49d7c7ff042d response_code = 200 uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWFjMTliZS0yMzc3LTQyMDItYmQzYS0xNjEyMjBiMjRkNDAifX0%3D
28482025-01-16T20:01:29.475ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:35562
28492025-01-16T20:01:29.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35562 req_id = 46ece565-d719-4605-ab05-836dd5a2c563 roles = RoleSet { roles: {} } uri = /metrics/producers
28502025-01-16T20:01:29.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35562 req_id = 46ece565-d719-4605-ab05-836dd5a2c563 resource = Database result = Ok(()) uri = /metrics/producers
28512025-01-16T20:01:29.513ZINFOnexus: assigned collector to new producer collector_id = d048ac10-211f-4354-a749-75b8d62cfaed file = nexus/src/app/oximeter.rs:76 producer_id = eeac19be-2377-4202-bd3a-161220b24d40
28522025-01-16T20:01:29.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38733 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35562 req_id = 46ece565-d719-4605-ab05-836dd5a2c563 response_code = 201 uri = /metrics/producers
28532025-01-16T20:01:32.684ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:49474 method = GET remote_addr = [fd00:1122:3344:101::d]:39316 req_id = 169626df-04b5-47b4-9f9b-455ac353ad15 response_code = 200 uri = /3c6582d4-0e42-407f-bc66-e913ef1c0f57
28542025-01-16T20:01:32.837ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
28552025-01-16T20:01:32.837ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
28562025-01-16T20:01:32.837ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
28572025-01-16T20:01:32.837ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28582025-01-16T20:01:32.837ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
28592025-01-16T20:01:32.837ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
28602025-01-16T20:01:32.837ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
28612025-01-16T20:01:32.837ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28622025-01-16T20:01:32.837ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28632025-01-16T20:01:32.837ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
28642025-01-16T20:01:32.837ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
28652025-01-16T20:01:32.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28662025-01-16T20:01:32.837ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
28672025-01-16T20:01:32.837ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
28682025-01-16T20:01:32.837ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28692025-01-16T20:01:32.837ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
28702025-01-16T20:01:32.837ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28712025-01-16T20:01:32.837ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
28722025-01-16T20:01:32.837ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
28732025-01-16T20:01:32.837ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28742025-01-16T20:01:32.837ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
28752025-01-16T20:01:32.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28762025-01-16T20:01:32.837ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28772025-01-16T20:01:32.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28782025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
28792025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28802025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
28812025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28822025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
28832025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
28842025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28852025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
28862025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
28872025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
28882025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28892025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
28902025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28912025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28922025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
28932025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28942025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28952025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28962025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
28972025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28982025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28992025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29002025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29012025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29022025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29032025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29042025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
29052025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29062025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29072025-01-16T20:01:32.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29082025-01-16T20:01:32.840ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29092025-01-16T20:01:32.841ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29102025-01-16T20:01:32.841ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.877748ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29112025-01-16T20:01:32.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29122025-01-16T20:01:32.842ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29132025-01-16T20:01:32.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29142025-01-16T20:01:32.842ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29152025-01-16T20:01:32.842ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1651, tv_nsec: 75172809 } })
29162025-01-16T20:01:32.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29172025-01-16T20:01:32.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29182025-01-16T20:01:32.843ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
29192025-01-16T20:01:32.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29202025-01-16T20:01:32.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
29212025-01-16T20:01:32.844ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29222025-01-16T20:01:32.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29232025-01-16T20:01:32.847ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1651, tv_nsec: 79582567 } })
29242025-01-16T20:01:32.847ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
29252025-01-16T20:01:32.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29262025-01-16T20:01:32.849ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29272025-01-16T20:01:32.849ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29282025-01-16T20:01:32.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29292025-01-16T20:01:32.851ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29302025-01-16T20:01:32.851ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1651, tv_nsec: 83871862 } })
29312025-01-16T20:01:32.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29322025-01-16T20:01:32.851ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f
29332025-01-16T20:01:32.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 41.214393ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
29342025-01-16T20:01:32.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29352025-01-16T20:01:32.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29362025-01-16T20:01:32.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29372025-01-16T20:01:32.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29382025-01-16T20:01:32.884ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29392025-01-16T20:01:32.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29402025-01-16T20:01:32.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29412025-01-16T20:01:32.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29422025-01-16T20:01:32.888ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29432025-01-16T20:01:32.888ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29442025-01-16T20:01:32.888ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29452025-01-16T20:01:32.888ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29462025-01-16T20:01:32.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29472025-01-16T20:01:32.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29482025-01-16T20:01:32.890ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29492025-01-16T20:01:32.890ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29502025-01-16T20:01:32.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29512025-01-16T20:01:32.890ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29522025-01-16T20:01:32.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29532025-01-16T20:01:32.891ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29542025-01-16T20:01:32.891ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29552025-01-16T20:01:32.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29562025-01-16T20:01:32.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29572025-01-16T20:01:32.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29582025-01-16T20:01:32.892ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29592025-01-16T20:01:32.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29602025-01-16T20:01:32.893ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29612025-01-16T20:01:32.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29622025-01-16T20:01:32.894ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29632025-01-16T20:01:32.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29642025-01-16T20:01:32.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29652025-01-16T20:01:32.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
29662025-01-16T20:01:32.895ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29672025-01-16T20:01:32.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29682025-01-16T20:01:32.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29692025-01-16T20:01:32.896ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
29702025-01-16T20:01:32.896ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 58.389885ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
29712025-01-16T20:01:32.897ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29722025-01-16T20:01:32.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29732025-01-16T20:01:32.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29742025-01-16T20:01:32.897ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29752025-01-16T20:01:32.897ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29762025-01-16T20:01:32.897ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29772025-01-16T20:01:32.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29782025-01-16T20:01:32.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29792025-01-16T20:01:32.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 39de0ab7-8c61-46aa-88f2-d42db34dffb8, lookup_type: ById(39de0ab7-8c61-46aa-88f2-d42db34dffb8) } result = Ok(())
29802025-01-16T20:01:32.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29812025-01-16T20:01:32.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29822025-01-16T20:01:32.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 68.456292ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
29832025-01-16T20:01:32.919ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.225495ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
29842025-01-16T20:01:32.921ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29852025-01-16T20:01:32.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29862025-01-16T20:01:32.923ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 original_time_created = 2025-01-16 19:48:51.140214 UTC target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 time_created = 2025-01-16 19:48:51.140214 UTC
29872025-01-16T20:01:32.923ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.694294ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"39de0ab7-8c61-46aa-88f2-d42db34dffb8","time_created":"2025-01-16T19:48:51.140214Z"}
29882025-01-16T20:01:32.923ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29892025-01-16T20:01:32.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29902025-01-16T20:01:32.926ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29912025-01-16T20:01:32.926ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
29922025-01-16T20:01:32.926ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29932025-01-16T20:01:32.927ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c9f5ec0-73b2-4c10-93cf-fadf26701732", "content-length": "26", "date": "Thu, 16 Jan 2025 20:01:32 GMT"} })
29942025-01-16T20:01:32.927ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29952025-01-16T20:01:32.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 87207105-a825-4eaa-ac6d-6aaa586b0fc5, lookup_type: ById(87207105-a825-4eaa-ac6d-6aaa586b0fc5) } result = Ok(())
29962025-01-16T20:01:32.928ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29972025-01-16T20:01:32.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29982025-01-16T20:01:32.929ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
29992025-01-16T20:01:32.929ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30002025-01-16T20:01:32.929ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a88cea7-5afb-40bf-8e4e-0175f3173d06", "content-length": "26", "date": "Thu, 16 Jan 2025 20:01:32 GMT"} })
30012025-01-16T20:01:32.929ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30022025-01-16T20:01:32.929ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30032025-01-16T20:01:32.930ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 92.268539ms iteration = 26 status = 0
30042025-01-16T20:01:32.930ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30052025-01-16T20:01:32.930ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30062025-01-16T20:01:32.930ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30072025-01-16T20:01:32.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30082025-01-16T20:01:32.932ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30092025-01-16T20:01:32.934ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30102025-01-16T20:01:32.934ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 96.456062ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30112025-01-16T20:01:32.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30122025-01-16T20:01:32.935ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 97.284457ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30132025-01-16T20:01:32.938ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30142025-01-16T20:01:32.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30152025-01-16T20:01:32.939ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
30162025-01-16T20:01:32.939ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 101.550792ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
30172025-01-16T20:01:32.942ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f zone_address = fd00:1122:3344:101::2
30182025-01-16T20:01:32.942ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30192025-01-16T20:01:32.942ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "69a04202-01d7-4802-89ec-3eec432d2c04", "content-length": "26", "date": "Thu, 16 Jan 2025 20:01:32 GMT"} })
30202025-01-16T20:01:32.942ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30212025-01-16T20:01:32.944ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 26dc04a7-8537-47d8-965d-0931849f651f
30222025-01-16T20:01:32.961ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30232025-01-16T20:01:32.961ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30242025-01-16T20:01:32.961ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 123.326944ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30252025-01-16T20:01:32.963ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 125.143786ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
30262025-01-16T20:01:33.005ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 167.616511ms iteration = 29 status = {"physical_disks_added":0}
30272025-01-16T20:01:33.033ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
30282025-01-16T20:01:33.033ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d413cd9a-acbd-4fcb-b601-5de97fb8bda5", "content-length": "2", "date": "Thu, 16 Jan 2025 20:01:32 GMT"} })
30292025-01-16T20:01:33.034ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30302025-01-16T20:01:33.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30312025-01-16T20:01:33.035ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30322025-01-16T20:01:33.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30332025-01-16T20:01:33.036ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30342025-01-16T20:01:33.037ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 199.878428ms iteration = 26 status = null
30352025-01-16T20:01:33.038ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30362025-01-16T20:01:33.038ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30372025-01-16T20:01:33.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30382025-01-16T20:01:33.048ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 210.582935ms iteration = 26 status = {}
30392025-01-16T20:01:33.055ZINFOnexus (BackgroundTasks): VPC route manager sled 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
30402025-01-16T20:01:33.055ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30412025-01-16T20:01:33.055ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6356aef7-f6a5-4fba-b285-5e2f18228d5e", "content-length": "372", "date": "Thu, 16 Jan 2025 20:01:32 GMT"} })
30422025-01-16T20:01:33.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30432025-01-16T20:01:33.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30442025-01-16T20:01:33.057ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30452025-01-16T20:01:33.058ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30462025-01-16T20:01:33.058ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30472025-01-16T20:01:33.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30482025-01-16T20:01:33.102ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
30492025-01-16T20:01:33.102ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
30502025-01-16T20:01:33.102ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "76912165-880b-4352-b291-0767de1f6f03", "date": "Thu, 16 Jan 2025 20:01:32 GMT"} })
30512025-01-16T20:01:33.102ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30522025-01-16T20:01:33.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30532025-01-16T20:01:33.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30542025-01-16T20:01:33.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30552025-01-16T20:01:33.112ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30562025-01-16T20:01:33.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30572025-01-16T20:01:33.116ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30582025-01-16T20:01:33.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30592025-01-16T20:01:33.116ZINFOnexus (BackgroundTasks): VPC route manager sled 87207105-a825-4eaa-ac6d-6aaa586b0fc5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
30602025-01-16T20:01:33.116ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30612025-01-16T20:01:33.117ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9558c2f7-ab47-44bc-a87b-2ab278353eb8", "date": "Thu, 16 Jan 2025 20:01:32 GMT"} })
30622025-01-16T20:01:33.118ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 280.581403ms iteration = 30 status = {}
30632025-01-16T20:01:33.118ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 6ec20bf0-03fa-4e36-9de7-54dd5e9cfde1, rack_id: 26dc04a7-8537-47d8-965d-0931849f651f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(438946af-d2bd-4eab-8036-57fe8293b9f9) } rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch_location = Switch0
30642025-01-16T20:01:33.118ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30652025-01-16T20:01:33.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30662025-01-16T20:01:33.127ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
30672025-01-16T20:01:33.127ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d33cafce-ee1f-407d-86fe-0adbd24f93b9", "content-length": "134", "date": "Thu, 16 Jan 2025 20:01:32 GMT"} })
30682025-01-16T20:01:33.127ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
30692025-01-16T20:01:33.127ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 438946af-d2bd-4eab-8036-57fe8293b9f9
30702025-01-16T20:01:33.128ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
30712025-01-16T20:01:33.128ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
30722025-01-16T20:01:33.128ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30732025-01-16T20:01:33.128ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30742025-01-16T20:01:33.128ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30752025-01-16T20:01:33.128ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30762025-01-16T20:01:33.128ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30772025-01-16T20:01:33.128ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30782025-01-16T20:01:33.128ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f
30792025-01-16T20:01:33.128ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30802025-01-16T20:01:33.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30812025-01-16T20:01:33.130ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
30822025-01-16T20:01:33.130ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "895aafd4-8e94-4b91-acbe-f95c44cd4f48", "content-length": "2", "date": "Thu, 16 Jan 2025 20:01:32 GMT"} })
30832025-01-16T20:01:33.130ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
30842025-01-16T20:01:33.130ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4f2bb1e-c3fa-40c3-accb-77c92d5e1879", "content-length": "52", "date": "Thu, 16 Jan 2025 20:01:32 GMT"} })
30852025-01-16T20:01:33.130ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch_location = Switch0
30862025-01-16T20:01:33.131ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
30872025-01-16T20:01:33.154ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
30882025-01-16T20:01:33.224ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a2383fed-e8f7-476b-ab71-cf540b80d2ad", "date": "Thu, 16 Jan 2025 20:01:32 GMT"} })
30892025-01-16T20:01:33.224ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch = Switch0
30902025-01-16T20:01:33.224ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
30912025-01-16T20:01:33.224ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "838c3a1d-df8c-4d57-96c6-b302e5b07484", "content-length": "691", "date": "Thu, 16 Jan 2025 20:01:32 GMT"} })
30922025-01-16T20:01:33.224ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
30932025-01-16T20:01:33.224ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
30942025-01-16T20:01:33.224ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
30952025-01-16T20:01:33.224ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bc60303-d044-4d88-9b69-ec886568996c", "content-length": "682", "date": "Thu, 16 Jan 2025 20:01:32 GMT"} })
30962025-01-16T20:01:33.224ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30972025-01-16T20:01:33.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30982025-01-16T20:01:33.226ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 388.174042ms iteration = 28 status = {}
30992025-01-16T20:01:33.227ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31002025-01-16T20:01:33.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31012025-01-16T20:01:33.230ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31022025-01-16T20:01:33.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31032025-01-16T20:01:33.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31042025-01-16T20:01:33.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31052025-01-16T20:01:33.239ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 401.843571ms iteration = 26 status = {}
31062025-01-16T20:01:38.739ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:36808
31072025-01-16T20:01:38.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36808 req_id = 88293b33-c9e2-4434-8efa-57a8e4e32c02 roles = RoleSet { roles: {} } uri = /metrics/producers
31082025-01-16T20:01:38.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36808 req_id = 88293b33-c9e2-4434-8efa-57a8e4e32c02 resource = Database result = Ok(()) uri = /metrics/producers
31092025-01-16T20:01:38.777ZINFOnexus: assigned collector to new producer collector_id = d048ac10-211f-4354-a749-75b8d62cfaed file = nexus/src/app/oximeter.rs:76 producer_id = 43da0a90-cae9-4986-95b4-7b6e63e0c4d4
31102025-01-16T20:01:38.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37648 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36808 req_id = 88293b33-c9e2-4434-8efa-57a8e4e32c02 response_code = 201 uri = /metrics/producers
31112025-01-16T20:01:42.684ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:49474 method = GET remote_addr = [fd00:1122:3344:101::d]:39316 req_id = b5a4a9fc-1ded-4e87-b3ba-443d05868764 response_code = 200 uri = /3c6582d4-0e42-407f-bc66-e913ef1c0f57
31122025-01-16T20:01:42.728ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
31132025-01-16T20:01:42.728ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
31142025-01-16T20:01:42.758ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
31152025-01-16T20:01:42.758ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:42847
31162025-01-16T20:01:42.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42847 req_id = a94c6244-e5f5-41f2-98dd-c5307a9096d7 roles = RoleSet { roles: {} } uri = /metrics/producers
31172025-01-16T20:01:42.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42847 req_id = a94c6244-e5f5-41f2-98dd-c5307a9096d7 resource = Database result = Ok(()) uri = /metrics/producers
31182025-01-16T20:01:42.797ZINFOnexus: assigned collector to new producer collector_id = d048ac10-211f-4354-a749-75b8d62cfaed file = nexus/src/app/oximeter.rs:76 producer_id = 3c6582d4-0e42-407f-bc66-e913ef1c0f57
31192025-01-16T20:01:42.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38592 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42847 req_id = a94c6244-e5f5-41f2-98dd-c5307a9096d7 response_code = 201 uri = /metrics/producers
31202025-01-16T20:01:42.797ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "a94c6244-e5f5-41f2-98dd-c5307a9096d7", "content-length": "41", "date": "Thu, 16 Jan 2025 20:01:42 GMT"} })
31212025-01-16T20:01:42.798ZDEBGnexus (producer-registration-task): registered with nexus successfully
31222025-01-16T20:01:42.798ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
31232025-01-16T20:01:42.838ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
31242025-01-16T20:01:42.838ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
31252025-01-16T20:01:42.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31262025-01-16T20:01:42.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31272025-01-16T20:01:42.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31282025-01-16T20:01:42.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31292025-01-16T20:01:42.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31302025-01-16T20:01:42.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31312025-01-16T20:01:42.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31322025-01-16T20:01:42.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31332025-01-16T20:01:42.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31342025-01-16T20:01:42.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31352025-01-16T20:01:42.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31362025-01-16T20:01:42.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 39de0ab7-8c61-46aa-88f2-d42db34dffb8, lookup_type: ById(39de0ab7-8c61-46aa-88f2-d42db34dffb8) } result = Ok(())
31372025-01-16T20:01:42.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31382025-01-16T20:01:42.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31392025-01-16T20:01:42.860ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 original_time_created = 2025-01-16 19:48:51.140214 UTC target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 time_created = 2025-01-16 19:48:51.140214 UTC
31402025-01-16T20:01:42.860ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.962375ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"39de0ab7-8c61-46aa-88f2-d42db34dffb8","time_created":"2025-01-16T19:48:51.140214Z"}
31412025-01-16T20:01:42.867ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31422025-01-16T20:01:42.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31432025-01-16T20:01:42.897ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.843922ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31442025-01-16T20:01:45.236ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:42939
31452025-01-16T20:01:45.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42939 req_id = c9c458fc-6fe9-46e0-ba42-a278c28e01dd roles = RoleSet { roles: {} } uri = /metrics/producers
31462025-01-16T20:01:45.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42939 req_id = c9c458fc-6fe9-46e0-ba42-a278c28e01dd resource = Database result = Ok(()) uri = /metrics/producers
31472025-01-16T20:01:45.250ZINFOnexus: assigned collector to new producer collector_id = d048ac10-211f-4354-a749-75b8d62cfaed file = nexus/src/app/oximeter.rs:76 producer_id = a14a72b8-50df-4a31-87e1-41ce5f287eee
31482025-01-16T20:01:45.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14619 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42939 req_id = c9c458fc-6fe9-46e0-ba42-a278c28e01dd response_code = 201 uri = /metrics/producers
31492025-01-16T20:01:45.446ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:65103
31502025-01-16T20:01:45.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:65103 req_id = 998a5c6e-f614-4fbe-af89-ae0cfee723aa roles = RoleSet { roles: {} } uri = /metrics/producers
31512025-01-16T20:01:45.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:65103 req_id = 998a5c6e-f614-4fbe-af89-ae0cfee723aa resource = Database result = Ok(()) uri = /metrics/producers
31522025-01-16T20:01:45.458ZINFOnexus: assigned collector to new producer collector_id = d048ac10-211f-4354-a749-75b8d62cfaed file = nexus/src/app/oximeter.rs:76 producer_id = 6d4e6eb2-a133-4aae-8c40-878af924e143
31532025-01-16T20:01:45.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12348 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:65103 req_id = 998a5c6e-f614-4fbe-af89-ae0cfee723aa response_code = 201 uri = /metrics/producers
31542025-01-16T20:01:50.471ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:43713
31552025-01-16T20:01:50.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43713 req_id = 07ebddc4-fd42-4527-9919-886ecd1f93e7 roles = RoleSet { roles: {} } uri = /metrics/producers
31562025-01-16T20:01:50.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43713 req_id = 07ebddc4-fd42-4527-9919-886ecd1f93e7 resource = Database result = Ok(()) uri = /metrics/producers
31572025-01-16T20:01:50.486ZINFOnexus: assigned collector to new producer collector_id = d048ac10-211f-4354-a749-75b8d62cfaed file = nexus/src/app/oximeter.rs:76 producer_id = 87207105-a825-4eaa-ac6d-6aaa586b0fc5
31582025-01-16T20:01:50.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14944 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43713 req_id = 07ebddc4-fd42-4527-9919-886ecd1f93e7 response_code = 201 uri = /metrics/producers
31592025-01-16T20:01:52.685ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::c]:49474 method = GET remote_addr = [fd00:1122:3344:101::d]:39316 req_id = 1fe9068a-8187-42d9-a1a8-2ad7f3a854c3 response_code = 200 uri = /3c6582d4-0e42-407f-bc66-e913ef1c0f57
31602025-01-16T20:01:52.837ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
31612025-01-16T20:01:52.837ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
31622025-01-16T20:01:52.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31632025-01-16T20:01:52.837ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31642025-01-16T20:01:52.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31652025-01-16T20:01:52.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31662025-01-16T20:01:52.840ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31672025-01-16T20:01:52.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31682025-01-16T20:01:52.869ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31692025-01-16T20:01:52.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31702025-01-16T20:01:52.871ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31712025-01-16T20:01:52.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31722025-01-16T20:01:52.874ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31732025-01-16T20:01:52.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31742025-01-16T20:01:52.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31752025-01-16T20:01:52.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.571486ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31762025-01-16T20:01:52.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 39de0ab7-8c61-46aa-88f2-d42db34dffb8, lookup_type: ById(39de0ab7-8c61-46aa-88f2-d42db34dffb8) } result = Ok(())
31772025-01-16T20:01:52.877ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31782025-01-16T20:01:52.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31792025-01-16T20:01:52.888ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 original_time_created = 2025-01-16 19:48:51.140214 UTC target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 time_created = 2025-01-16 19:48:51.140214 UTC
31802025-01-16T20:01:52.888ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.065596ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"39de0ab7-8c61-46aa-88f2-d42db34dffb8","time_created":"2025-01-16T19:48:51.140214Z"}
31812025-01-16T20:02:02.686ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3232 local_addr = [fd00:1122:3344:101::c]:49474 method = GET remote_addr = [fd00:1122:3344:101::d]:39316 req_id = 00cfcfca-9b57-4ed8-bdfe-c97a187a039a response_code = 200 uri = /3c6582d4-0e42-407f-bc66-e913ef1c0f57
31822025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
31832025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
31842025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
31852025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31862025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
31872025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31882025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
31892025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
31902025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
31912025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
31922025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31932025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
31942025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
31952025-01-16T20:02:02.838ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-16 19:52:02.838686970 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
31962025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
31972025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
31982025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
31992025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
32002025-01-16T20:02:02.838ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
32012025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
32022025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32032025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
32042025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
32052025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
32062025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
32072025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32082025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32092025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
32102025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32112025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
32122025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
32132025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32142025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32152025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
32162025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
32172025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
32182025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32192025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
32202025-01-16T20:02:02.838ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
32212025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
32222025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32232025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32242025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
32252025-01-16T20:02:02.838ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
32262025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
32272025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32282025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
32292025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
32302025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32312025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
32322025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32332025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
32342025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
32352025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
32362025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32372025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
32382025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
32392025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
32402025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32412025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
32422025-01-16T20:02:02.839ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8
32432025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.01\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"39de0ab7-8c61-46aa-88f2-d42db34dffb8"}
32442025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
32452025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
32462025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32472025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
32482025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32492025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32502025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
32512025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32522025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32532025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32542025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32552025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
32562025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32572025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
32582025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32592025-01-16T20:02:02.839ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("67baed66-640b-413d-8436-22e580c71fff.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b6525081-e08a-4759-918e-50f60ff0f6f1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b6525081-e08a-4759-918e-50f60ff0f6f1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1681, tv_nsec: 71345682 } })
32602025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32612025-01-16T20:02:02.839ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1673b82a-d301-40a0-97f5-01c1919bcccc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a78ec168-75b0-4c15-b272-0f34e450b715.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fc5e4155-1b26-42b3-8db4-a4cf6dd61fe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fc5e4155-1b26-42b3-8db4-a4cf6dd61fe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1681, tv_nsec: 71374182 } })
32622025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32632025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32642025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32652025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
32662025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32672025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32682025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32692025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
32702025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
32712025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32722025-01-16T20:02:02.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
32732025-01-16T20:02:02.840ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
32742025-01-16T20:02:02.840ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.367394ms iteration = 15 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
32752025-01-16T20:02:02.840ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
32762025-01-16T20:02:02.840ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.440866ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
32772025-01-16T20:02:02.841ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32782025-01-16T20:02:02.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32792025-01-16T20:02:02.842ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32802025-01-16T20:02:02.843ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.693662ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
32812025-01-16T20:02:02.844ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-16 19:52:02.838686970 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
32822025-01-16T20:02:02.844ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.981885ms iteration = 14 status = {"expiration":"2025-01-16T19:52:02.838686970Z","pruned":[]}
32832025-01-16T20:02:02.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
32842025-01-16T20:02:02.845ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32852025-01-16T20:02:02.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32862025-01-16T20:02:02.848ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32872025-01-16T20:02:02.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
32882025-01-16T20:02:02.850ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
32892025-01-16T20:02:02.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
32902025-01-16T20:02:02.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32912025-01-16T20:02:02.852ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32922025-01-16T20:02:02.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32932025-01-16T20:02:02.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32942025-01-16T20:02:02.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32952025-01-16T20:02:02.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32962025-01-16T20:02:02.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32972025-01-16T20:02:02.854ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32982025-01-16T20:02:02.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32992025-01-16T20:02:02.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33002025-01-16T20:02:02.855ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33012025-01-16T20:02:02.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33022025-01-16T20:02:02.856ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33032025-01-16T20:02:02.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33042025-01-16T20:02:02.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33052025-01-16T20:02:02.857ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.380513ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
33062025-01-16T20:02:02.857ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1681, tv_nsec: 89407679 } })
33072025-01-16T20:02:02.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
33082025-01-16T20:02:02.857ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33092025-01-16T20:02:02.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33102025-01-16T20:02:02.857ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
33112025-01-16T20:02:02.860ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1681, tv_nsec: 92145717 } })
33122025-01-16T20:02:02.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33132025-01-16T20:02:02.860ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
33142025-01-16T20:02:02.861ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33152025-01-16T20:02:02.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33162025-01-16T20:02:02.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33172025-01-16T20:02:02.866ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33182025-01-16T20:02:02.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33192025-01-16T20:02:02.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33202025-01-16T20:02:02.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33212025-01-16T20:02:02.871ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.845087ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33222025-01-16T20:02:02.873ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1681, tv_nsec: 104970712 } })
33232025-01-16T20:02:02.873ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f
33242025-01-16T20:02:02.890ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33252025-01-16T20:02:02.890ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
33262025-01-16T20:02:02.890ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33272025-01-16T20:02:02.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33282025-01-16T20:02:02.891ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 53.00742ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
33292025-01-16T20:02:02.893ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33302025-01-16T20:02:02.893ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
33312025-01-16T20:02:02.893ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33322025-01-16T20:02:02.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33332025-01-16T20:02:02.894ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33342025-01-16T20:02:02.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33352025-01-16T20:02:02.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33362025-01-16T20:02:02.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33372025-01-16T20:02:02.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33382025-01-16T20:02:02.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33392025-01-16T20:02:02.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33402025-01-16T20:02:02.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
33412025-01-16T20:02:02.904ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33422025-01-16T20:02:02.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33432025-01-16T20:02:02.906ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33442025-01-16T20:02:02.906ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 68.149346ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
33452025-01-16T20:02:02.907ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33462025-01-16T20:02:02.908ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
33472025-01-16T20:02:02.908ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33482025-01-16T20:02:02.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33492025-01-16T20:02:02.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33502025-01-16T20:02:02.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33512025-01-16T20:02:02.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
33522025-01-16T20:02:02.910ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33532025-01-16T20:02:02.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33542025-01-16T20:02:02.911ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
33552025-01-16T20:02:02.911ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
33562025-01-16T20:02:02.911ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
33572025-01-16T20:02:02.911ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33582025-01-16T20:02:02.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33592025-01-16T20:02:02.912ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33602025-01-16T20:02:02.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33612025-01-16T20:02:02.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33622025-01-16T20:02:02.914ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33632025-01-16T20:02:02.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33642025-01-16T20:02:02.915ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33652025-01-16T20:02:02.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33662025-01-16T20:02:02.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
33672025-01-16T20:02:02.918ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33682025-01-16T20:02:02.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33692025-01-16T20:02:02.918ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33702025-01-16T20:02:02.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33712025-01-16T20:02:02.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33722025-01-16T20:02:02.919ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33732025-01-16T20:02:02.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33742025-01-16T20:02:02.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33752025-01-16T20:02:02.922ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33762025-01-16T20:02:02.922ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
33772025-01-16T20:02:02.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
33782025-01-16T20:02:02.922ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
33792025-01-16T20:02:02.922ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
33802025-01-16T20:02:02.922ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
33812025-01-16T20:02:02.922ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33822025-01-16T20:02:02.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33832025-01-16T20:02:02.925ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
33842025-01-16T20:02:02.925ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
33852025-01-16T20:02:02.925ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 86.262683ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
33862025-01-16T20:02:02.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33872025-01-16T20:02:02.925ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33882025-01-16T20:02:02.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33892025-01-16T20:02:02.927ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
33902025-01-16T20:02:02.927ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f05be43b-5d84-4b95-99be-d6d0a1e3a923 dns_zone_name = oxide.test found_so_far = 0 version = 2
33912025-01-16T20:02:02.927ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33922025-01-16T20:02:02.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33932025-01-16T20:02:02.928ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33942025-01-16T20:02:02.929ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33952025-01-16T20:02:02.929ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33962025-01-16T20:02:02.930ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33972025-01-16T20:02:02.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33982025-01-16T20:02:02.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
33992025-01-16T20:02:02.931ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
34002025-01-16T20:02:02.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
34012025-01-16T20:02:02.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34022025-01-16T20:02:02.932ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34032025-01-16T20:02:02.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34042025-01-16T20:02:02.933ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34052025-01-16T20:02:02.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34062025-01-16T20:02:02.934ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34072025-01-16T20:02:02.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34082025-01-16T20:02:02.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 39de0ab7-8c61-46aa-88f2-d42db34dffb8, lookup_type: ById(39de0ab7-8c61-46aa-88f2-d42db34dffb8) } result = Ok(())
34092025-01-16T20:02:02.936ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34102025-01-16T20:02:02.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34112025-01-16T20:02:02.938ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34122025-01-16T20:02:02.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34132025-01-16T20:02:02.943ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34142025-01-16T20:02:02.945ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34152025-01-16T20:02:02.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34162025-01-16T20:02:02.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 107.302562ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
34172025-01-16T20:02:02.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34182025-01-16T20:02:02.947ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34192025-01-16T20:02:02.949ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34202025-01-16T20:02:02.949ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34212025-01-16T20:02:02.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34222025-01-16T20:02:02.951ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
34232025-01-16T20:02:02.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
34242025-01-16T20:02:02.952ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34252025-01-16T20:02:02.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34262025-01-16T20:02:02.953ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34272025-01-16T20:02:02.953ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
34282025-01-16T20:02:02.953ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.398447ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
34292025-01-16T20:02:02.957ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 original_time_created = 2025-01-16 19:48:51.140214 UTC target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 time_created = 2025-01-16 19:48:51.140214 UTC
34302025-01-16T20:02:02.957ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 119.011168ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"39de0ab7-8c61-46aa-88f2-d42db34dffb8","time_created":"2025-01-16T19:48:51.140214Z"}
34312025-01-16T20:02:02.961ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34322025-01-16T20:02:02.964ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 125.780617ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
34332025-01-16T20:02:02.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34342025-01-16T20:02:02.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 87207105-a825-4eaa-ac6d-6aaa586b0fc5, lookup_type: ById(87207105-a825-4eaa-ac6d-6aaa586b0fc5) } result = Ok(())
34352025-01-16T20:02:02.965ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34362025-01-16T20:02:02.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34372025-01-16T20:02:02.965ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34382025-01-16T20:02:02.966ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
34392025-01-16T20:02:02.966ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 127.300573ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
34402025-01-16T20:02:02.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34412025-01-16T20:02:02.967ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
34422025-01-16T20:02:02.967ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
34432025-01-16T20:02:02.967ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 128.304571ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
34442025-01-16T20:02:02.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34452025-01-16T20:02:02.967ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34462025-01-16T20:02:02.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34472025-01-16T20:02:02.969ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
34482025-01-16T20:02:02.969ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 130.540241ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
34492025-01-16T20:02:02.975ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
34502025-01-16T20:02:02.975ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 481516d2-3f4d-4dc5-9036-8c14a1fa4fd7 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
34512025-01-16T20:02:02.975ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34522025-01-16T20:02:02.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34532025-01-16T20:02:02.988ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 149.400302ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
34542025-01-16T20:02:03.012ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
34552025-01-16T20:02:03.012ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 174.232217ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
34562025-01-16T20:02:03.036ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 197.806211ms iteration = 30 status = {"physical_disks_added":0}
34572025-01-16T20:02:03.048ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
34582025-01-16T20:02:03.092ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
34592025-01-16T20:02:03.092ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34602025-01-16T20:02:03.092ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa5f3305-7ded-4405-9b9a-929e5260f0df", "content-length": "26", "date": "Thu, 16 Jan 2025 20:02:02 GMT"} })
34612025-01-16T20:02:03.092ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34622025-01-16T20:02:03.094ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34632025-01-16T20:02:03.108ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
34642025-01-16T20:02:03.155ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
34652025-01-16T20:02:03.155ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34662025-01-16T20:02:03.155ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "75a05343-55f7-498c-adb7-82e752372417", "content-length": "26", "date": "Thu, 16 Jan 2025 20:02:02 GMT"} })
34672025-01-16T20:02:03.155ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34682025-01-16T20:02:03.158ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34692025-01-16T20:02:03.278ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
34702025-01-16T20:02:03.278ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d827312-322a-4a93-8487-83a6ea804bf0", "content-length": "691", "date": "Thu, 16 Jan 2025 20:02:02 GMT"} })
34712025-01-16T20:02:03.278ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
34722025-01-16T20:02:03.278ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
34732025-01-16T20:02:03.278ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
34742025-01-16T20:02:03.280ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 441.774512ms iteration = 29 status = {}
34752025-01-16T20:02:03.284ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f zone_address = fd00:1122:3344:101::2
34762025-01-16T20:02:03.284ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34772025-01-16T20:02:03.284ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "35fab7ce-7913-4c6a-87b5-fb9b4db4419c", "content-length": "26", "date": "Thu, 16 Jan 2025 20:02:02 GMT"} })
34782025-01-16T20:02:03.284ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34792025-01-16T20:02:03.286ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 26dc04a7-8537-47d8-965d-0931849f651f
34802025-01-16T20:02:03.322ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
34812025-01-16T20:02:03.379ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 540.691837ms iteration = 27 status = {}
34822025-01-16T20:02:03.383ZINFOnexus (BackgroundTasks): VPC route manager sled 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
34832025-01-16T20:02:03.383ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34842025-01-16T20:02:03.383ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f82c333-5d61-41d8-981f-625350e0b34e", "content-length": "372", "date": "Thu, 16 Jan 2025 20:02:02 GMT"} })
34852025-01-16T20:02:03.383ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34862025-01-16T20:02:03.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34872025-01-16T20:02:03.385ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34882025-01-16T20:02:03.385ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f05be43b-5d84-4b95-99be-d6d0a1e3a923 dns_zone_name = oxide.test found_so_far = 1 version = 2
34892025-01-16T20:02:03.385ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
34902025-01-16T20:02:03.385ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-16 19:49:10.849798 UTC dns_group = external generation = 2
34912025-01-16T20:02:03.385ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 547.349025ms iteration = 15 status = {"generation":2}
34922025-01-16T20:02:03.385ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 547.330204ms iteration = 27 status = 0
34932025-01-16T20:02:03.387ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34942025-01-16T20:02:03.387ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34952025-01-16T20:02:03.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34962025-01-16T20:02:03.387ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
34972025-01-16T20:02:03.388ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "97d4d3ac-a07a-45d4-bccb-7574f8ccd748", "content-length": "2", "date": "Thu, 16 Jan 2025 20:02:03 GMT"} })
34982025-01-16T20:02:03.389ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34992025-01-16T20:02:03.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35002025-01-16T20:02:03.391ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 552.904762ms iteration = 27 status = null
35012025-01-16T20:02:03.414ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
35022025-01-16T20:02:03.415ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35032025-01-16T20:02:03.415ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3ebcbb96-0af6-47d6-8b2f-13b9f80d36e6", "date": "Thu, 16 Jan 2025 20:02:02 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35042025-01-16T20:02:03.415ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35052025-01-16T20:02:03.417ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4e90887e-9a1e-4ec5-86a3-b5df25d4f4e3", "date": "Thu, 16 Jan 2025 20:02:02 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35062025-01-16T20:02:03.417ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35072025-01-16T20:02:03.417ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35082025-01-16T20:02:03.417ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35092025-01-16T20:02:03.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35102025-01-16T20:02:03.419ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35112025-01-16T20:02:03.419ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 580.518706ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
35122025-01-16T20:02:03.420ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 481516d2-3f4d-4dc5-9036-8c14a1fa4fd7 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
35132025-01-16T20:02:03.420ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
35142025-01-16T20:02:03.420ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-16 19:49:07.686045 UTC dns_group = internal generation = 1
35152025-01-16T20:02:03.420ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 581.915961ms iteration = 15 status = {"generation":1}
35162025-01-16T20:02:03.425ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-16T19:48:57.779461Z, time_modified: 2025-01-16T19:48:57.779461Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, db_silo: Silo { identity: SiloIdentity { id: 197fa9bd-2b54-417a-8249-a5354e078485, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T19:49:10.527303Z, time_modified: 2025-01-16T19:49:10.527303Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b24122d5f92c7bd84d282bd8841cee73a1e4d9ad23f30c8a432049fc1b2c4538" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 197fa9bd-2b54-417a-8249-a5354e078485, db_silo: Silo { identity: SiloIdentity { id: 197fa9bd-2b54-417a-8249-a5354e078485, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-16T19:49:10.527303Z, time_modified: 2025-01-16T19:49:10.527303Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "b24122d5f92c7bd84d282bd8841cee73a1e4d9ad23f30c8a432049fc1b2c4538" }] }) }
35172025-01-16T20:02:03.425ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 587.140383ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"197fa9bd-2b54-417a-8249-a5354e078485","tls_certs":["b24122d5f92c7bd84d282bd8841cee73a1e4d9ad23f30c8a432049fc1b2c4538"]}},"default_endpoint":{"silo_id":"197fa9bd-2b54-417a-8249-a5354e078485","tls_certs":["b24122d5f92c7bd84d282bd8841cee73a1e4d9ad23f30c8a432049fc1b2c4538"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
35182025-01-16T20:02:03.431ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
35192025-01-16T20:02:03.431ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
35202025-01-16T20:02:03.431ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ca812a92-491f-426c-86c9-de08ad1dbf9f", "date": "Thu, 16 Jan 2025 20:02:02 GMT"} })
35212025-01-16T20:02:03.431ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35222025-01-16T20:02:03.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35232025-01-16T20:02:03.434ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
35242025-01-16T20:02:03.434ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "02be307a-42ea-45af-8138-26c909e128d5", "date": "Thu, 16 Jan 2025 20:02:02 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
35252025-01-16T20:02:03.434ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
35262025-01-16T20:02:03.434ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35272025-01-16T20:02:03.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35282025-01-16T20:02:03.436ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "1822c17c-3859-40b3-a7df-b33dc0cb7d4b", "date": "Thu, 16 Jan 2025 20:02:03 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
35292025-01-16T20:02:03.436ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
35302025-01-16T20:02:03.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35312025-01-16T20:02:03.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35322025-01-16T20:02:03.438ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "4c250490-afaa-45e9-90b2-1baa998bc42d", "date": "Thu, 16 Jan 2025 20:02:02 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
35332025-01-16T20:02:03.438ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
35342025-01-16T20:02:03.441ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
35352025-01-16T20:02:03.441ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 602.420321ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
35362025-01-16T20:02:03.441ZINFOnexus (BackgroundTasks): VPC route manager sled 87207105-a825-4eaa-ac6d-6aaa586b0fc5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
35372025-01-16T20:02:03.441ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35382025-01-16T20:02:03.442ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "12d43ca3-22de-42b1-82b9-e6946154875f", "date": "Thu, 16 Jan 2025 20:02:02 GMT"} })
35392025-01-16T20:02:03.444ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 605.611367ms iteration = 31 status = {}
35402025-01-16T20:02:03.502ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35412025-01-16T20:02:03.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35422025-01-16T20:02:03.505ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 6ec20bf0-03fa-4e36-9de7-54dd5e9cfde1, rack_id: 26dc04a7-8537-47d8-965d-0931849f651f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(438946af-d2bd-4eab-8036-57fe8293b9f9) } rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch_location = Switch0
35432025-01-16T20:02:03.505ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35442025-01-16T20:02:03.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35452025-01-16T20:02:03.513ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
35462025-01-16T20:02:03.513ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9668ba20-d46e-49d7-9698-eafc4a0a6725", "content-length": "134", "date": "Thu, 16 Jan 2025 20:02:03 GMT"} })
35472025-01-16T20:02:03.513ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
35482025-01-16T20:02:03.513ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 438946af-d2bd-4eab-8036-57fe8293b9f9
35492025-01-16T20:02:03.514ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
35502025-01-16T20:02:03.514ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
35512025-01-16T20:02:03.514ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35522025-01-16T20:02:03.514ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35532025-01-16T20:02:03.514ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35542025-01-16T20:02:03.514ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35552025-01-16T20:02:03.514ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35562025-01-16T20:02:03.514ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35572025-01-16T20:02:03.514ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f
35582025-01-16T20:02:03.514ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35592025-01-16T20:02:03.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35602025-01-16T20:02:03.516ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
35612025-01-16T20:02:03.516ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "60f4a722-d445-4b73-aefd-db30558c7e30", "content-length": "2", "date": "Thu, 16 Jan 2025 20:02:03 GMT"} })
35622025-01-16T20:02:03.516ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
35632025-01-16T20:02:03.516ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdc55804-6356-43a5-b6ba-eeb77d18e0ae", "content-length": "52", "date": "Thu, 16 Jan 2025 20:02:03 GMT"} })
35642025-01-16T20:02:03.516ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch_location = Switch0
35652025-01-16T20:02:03.516ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
35662025-01-16T20:02:03.609ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7db5e74c-284c-4ee4-9211-b323d1bed1a5", "date": "Thu, 16 Jan 2025 20:02:02 GMT"} })
35672025-01-16T20:02:03.609ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch = Switch0
35682025-01-16T20:02:03.609ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
35692025-01-16T20:02:03.609ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "875488a6-2f65-4f59-befc-5c4093a35a93", "content-length": "682", "date": "Thu, 16 Jan 2025 20:02:02 GMT"} })
35702025-01-16T20:02:03.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35712025-01-16T20:02:03.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35722025-01-16T20:02:03.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35732025-01-16T20:02:03.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35742025-01-16T20:02:03.616ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35752025-01-16T20:02:03.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35762025-01-16T20:02:03.618ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35772025-01-16T20:02:03.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35782025-01-16T20:02:03.625ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 786.806856ms iteration = 27 status = {}
35792025-01-16T20:02:12.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 64a06d52-5579-4a8b-8709-360adc68258d roles = RoleSet { roles: {} } uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?sort_by=id_ascending
35802025-01-16T20:02:12.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 64a06d52-5579-4a8b-8709-360adc68258d resource = Database result = Ok(()) uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?sort_by=id_ascending
35812025-01-16T20:02:12.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2863 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 64a06d52-5579-4a8b-8709-360adc68258d response_code = 200 uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?sort_by=id_ascending
35822025-01-16T20:02:12.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 7215b8e2-54e9-4819-990f-df6a9542dc44 roles = RoleSet { roles: {} } uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWFjMTliZS0yMzc3LTQyMDItYmQzYS0xNjEyMjBiMjRkNDAifX0%3D
35832025-01-16T20:02:12.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 7215b8e2-54e9-4819-990f-df6a9542dc44 resource = Database result = Ok(()) uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWFjMTliZS0yMzc3LTQyMDItYmQzYS0xNjEyMjBiMjRkNDAifX0%3D
35842025-01-16T20:02:12.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 7215b8e2-54e9-4819-990f-df6a9542dc44 response_code = 200 uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWFjMTliZS0yMzc3LTQyMDItYmQzYS0xNjEyMjBiMjRkNDAifX0%3D
35852025-01-16T20:02:12.685ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:49474 method = GET remote_addr = [fd00:1122:3344:101::d]:39316 req_id = 72f87134-4312-454d-8bb0-267bb5391770 response_code = 200 uri = /3c6582d4-0e42-407f-bc66-e913ef1c0f57
35862025-01-16T20:02:12.838ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
35872025-01-16T20:02:12.838ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
35882025-01-16T20:02:12.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35892025-01-16T20:02:12.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35902025-01-16T20:02:12.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35912025-01-16T20:02:12.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35922025-01-16T20:02:12.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35932025-01-16T20:02:12.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35942025-01-16T20:02:12.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35952025-01-16T20:02:12.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35962025-01-16T20:02:12.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35972025-01-16T20:02:12.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35982025-01-16T20:02:12.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35992025-01-16T20:02:12.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 39de0ab7-8c61-46aa-88f2-d42db34dffb8, lookup_type: ById(39de0ab7-8c61-46aa-88f2-d42db34dffb8) } result = Ok(())
36002025-01-16T20:02:12.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36012025-01-16T20:02:12.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36022025-01-16T20:02:12.862ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 original_time_created = 2025-01-16 19:48:51.140214 UTC target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 time_created = 2025-01-16 19:48:51.140214 UTC
36032025-01-16T20:02:12.862ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.420791ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"39de0ab7-8c61-46aa-88f2-d42db34dffb8","time_created":"2025-01-16T19:48:51.140214Z"}
36042025-01-16T20:02:12.869ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36052025-01-16T20:02:12.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36062025-01-16T20:02:12.898ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.262628ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36072025-01-16T20:02:15.502ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:62004
36082025-01-16T20:02:15.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62004 req_id = 0004faf9-f9be-4eb8-9d95-aa8f048dda6a roles = RoleSet { roles: {} } uri = /metrics/producers
36092025-01-16T20:02:15.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62004 req_id = 0004faf9-f9be-4eb8-9d95-aa8f048dda6a resource = Database result = Ok(()) uri = /metrics/producers
36102025-01-16T20:02:15.551ZINFOnexus: assigned collector to new producer collector_id = d048ac10-211f-4354-a749-75b8d62cfaed file = nexus/src/app/oximeter.rs:76 producer_id = 7abdba2e-3098-4328-a6be-9459067ed21a
36112025-01-16T20:02:15.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49939 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62004 req_id = 0004faf9-f9be-4eb8-9d95-aa8f048dda6a response_code = 201 uri = /metrics/producers
36122025-01-16T20:02:22.685ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:49474 method = GET remote_addr = [fd00:1122:3344:101::d]:39316 req_id = 5148feea-69d7-4cf4-b427-150794d3f58f response_code = 200 uri = /3c6582d4-0e42-407f-bc66-e913ef1c0f57
36132025-01-16T20:02:22.838ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
36142025-01-16T20:02:22.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36152025-01-16T20:02:22.838ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
36162025-01-16T20:02:22.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36172025-01-16T20:02:22.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36182025-01-16T20:02:22.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36192025-01-16T20:02:22.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36202025-01-16T20:02:22.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36212025-01-16T20:02:22.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36222025-01-16T20:02:22.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36232025-01-16T20:02:22.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36242025-01-16T20:02:22.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36252025-01-16T20:02:22.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36262025-01-16T20:02:22.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 39de0ab7-8c61-46aa-88f2-d42db34dffb8, lookup_type: ById(39de0ab7-8c61-46aa-88f2-d42db34dffb8) } result = Ok(())
36272025-01-16T20:02:22.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36282025-01-16T20:02:22.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36292025-01-16T20:02:22.860ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 original_time_created = 2025-01-16 19:48:51.140214 UTC target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 time_created = 2025-01-16 19:48:51.140214 UTC
36302025-01-16T20:02:22.860ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.756132ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"39de0ab7-8c61-46aa-88f2-d42db34dffb8","time_created":"2025-01-16T19:48:51.140214Z"}
36312025-01-16T20:02:22.867ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36322025-01-16T20:02:22.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36332025-01-16T20:02:22.894ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.281088ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36342025-01-16T20:02:27.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 4636ea1d-092f-4f70-8df2-af6c5fd5c739 roles = RoleSet { roles: {} } uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?sort_by=id_ascending
36352025-01-16T20:02:27.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 4636ea1d-092f-4f70-8df2-af6c5fd5c739 resource = Database result = Ok(()) uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?sort_by=id_ascending
36362025-01-16T20:02:27.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2932 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 4636ea1d-092f-4f70-8df2-af6c5fd5c739 response_code = 200 uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?sort_by=id_ascending
36372025-01-16T20:02:27.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 08711575-d094-48a0-86ed-fac418e2b9db roles = RoleSet { roles: {} } uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWFjMTliZS0yMzc3LTQyMDItYmQzYS0xNjEyMjBiMjRkNDAifX0%3D
36382025-01-16T20:02:27.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 08711575-d094-48a0-86ed-fac418e2b9db resource = Database result = Ok(()) uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWFjMTliZS0yMzc3LTQyMDItYmQzYS0xNjEyMjBiMjRkNDAifX0%3D
36392025-01-16T20:02:27.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1793 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 08711575-d094-48a0-86ed-fac418e2b9db response_code = 200 uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWFjMTliZS0yMzc3LTQyMDItYmQzYS0xNjEyMjBiMjRkNDAifX0%3D
36402025-01-16T20:02:32.685ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:49474 method = GET remote_addr = [fd00:1122:3344:101::d]:39316 req_id = f532ef08-d4a1-494e-96a4-8bff4d9df903 response_code = 200 uri = /3c6582d4-0e42-407f-bc66-e913ef1c0f57
36412025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
36422025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
36432025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
36442025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36452025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
36462025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
36472025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36482025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
36492025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
36502025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
36512025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
36522025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36532025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
36542025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36552025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
36562025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
36572025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
36582025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36592025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36602025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
36612025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
36622025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36632025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36642025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
36652025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36662025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
36672025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
36682025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36692025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
36702025-01-16T20:02:32.839ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
36712025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
36722025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36732025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36742025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
36752025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36762025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 28 reason = Timeout
36772025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
36782025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
36792025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
36802025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36812025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36822025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36832025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36842025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36852025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36862025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36872025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36882025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36892025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36902025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36912025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
36922025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
36932025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36942025-01-16T20:02:32.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36952025-01-16T20:02:32.842ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1711, tv_nsec: 74225183 } })
36962025-01-16T20:02:32.843ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
36972025-01-16T20:02:32.843ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.183864ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
36982025-01-16T20:02:32.843ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1711, tv_nsec: 75349953 } })
36992025-01-16T20:02:32.844ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
37002025-01-16T20:02:32.846ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37012025-01-16T20:02:32.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
37022025-01-16T20:02:32.849ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37032025-01-16T20:02:32.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37042025-01-16T20:02:32.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37052025-01-16T20:02:32.854ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37062025-01-16T20:02:32.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37072025-01-16T20:02:32.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37082025-01-16T20:02:32.878ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37092025-01-16T20:02:32.879ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 40.249246ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
37102025-01-16T20:02:32.879ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37112025-01-16T20:02:32.879ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37122025-01-16T20:02:32.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37132025-01-16T20:02:32.880ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37142025-01-16T20:02:32.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37152025-01-16T20:02:32.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
37162025-01-16T20:02:32.881ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37172025-01-16T20:02:32.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37182025-01-16T20:02:32.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37192025-01-16T20:02:32.882ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37202025-01-16T20:02:32.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37212025-01-16T20:02:32.882ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37222025-01-16T20:02:32.882ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37232025-01-16T20:02:32.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37242025-01-16T20:02:32.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37252025-01-16T20:02:32.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37262025-01-16T20:02:32.884ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-87207105-a825-4eaa-ac6d-6aaa586b0fc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1711, tv_nsec: 116471764 } })
37272025-01-16T20:02:32.885ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f
37282025-01-16T20:02:32.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
37292025-01-16T20:02:32.885ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37302025-01-16T20:02:32.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37312025-01-16T20:02:32.886ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37322025-01-16T20:02:32.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37332025-01-16T20:02:32.887ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 48.40155ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37342025-01-16T20:02:32.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37352025-01-16T20:02:32.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37362025-01-16T20:02:32.892ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37372025-01-16T20:02:32.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37382025-01-16T20:02:32.895ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37392025-01-16T20:02:32.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37402025-01-16T20:02:32.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37412025-01-16T20:02:32.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37422025-01-16T20:02:32.897ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37432025-01-16T20:02:32.899ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 59.83375ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37442025-01-16T20:02:32.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37452025-01-16T20:02:32.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
37462025-01-16T20:02:32.900ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
37472025-01-16T20:02:32.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
37482025-01-16T20:02:32.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37492025-01-16T20:02:32.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37502025-01-16T20:02:32.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.384362ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
37512025-01-16T20:02:32.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37522025-01-16T20:02:32.902ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
37532025-01-16T20:02:32.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
37542025-01-16T20:02:32.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37552025-01-16T20:02:32.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37562025-01-16T20:02:32.904ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37572025-01-16T20:02:32.905ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37582025-01-16T20:02:32.905ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
37592025-01-16T20:02:32.905ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37602025-01-16T20:02:32.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
37612025-01-16T20:02:32.906ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
37622025-01-16T20:02:32.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37632025-01-16T20:02:32.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
37642025-01-16T20:02:32.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37652025-01-16T20:02:32.909ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37662025-01-16T20:02:32.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37672025-01-16T20:02:32.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37682025-01-16T20:02:32.911ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
37692025-01-16T20:02:32.911ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.019684ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
37702025-01-16T20:02:32.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37712025-01-16T20:02:32.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37722025-01-16T20:02:32.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37732025-01-16T20:02:32.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37742025-01-16T20:02:32.920ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37752025-01-16T20:02:32.922ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 83.066508ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
37762025-01-16T20:02:32.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 87207105-a825-4eaa-ac6d-6aaa586b0fc5, lookup_type: ById(87207105-a825-4eaa-ac6d-6aaa586b0fc5) } result = Ok(())
37772025-01-16T20:02:32.923ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37782025-01-16T20:02:32.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37792025-01-16T20:02:32.925ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 86.570219ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37802025-01-16T20:02:32.926ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 87.2004ms iteration = 28 status = 0
37812025-01-16T20:02:32.932ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
37822025-01-16T20:02:32.932ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37832025-01-16T20:02:32.933ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "262546dd-cc44-4c7d-b4d8-d7e33262527a", "content-length": "26", "date": "Thu, 16 Jan 2025 20:02:32 GMT"} })
37842025-01-16T20:02:32.933ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37852025-01-16T20:02:32.934ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37862025-01-16T20:02:32.938ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
37872025-01-16T20:02:32.938ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 98.805064ms iteration = 28 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
37882025-01-16T20:02:32.943ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37892025-01-16T20:02:32.944ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
37902025-01-16T20:02:32.944ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37912025-01-16T20:02:32.944ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad3a06f0-8390-40a2-85ad-170a92718a3a", "content-length": "26", "date": "Thu, 16 Jan 2025 20:02:32 GMT"} })
37922025-01-16T20:02:32.944ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37932025-01-16T20:02:32.945ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37942025-01-16T20:02:32.945ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
37952025-01-16T20:02:32.945ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37962025-01-16T20:02:32.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37972025-01-16T20:02:32.946ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37982025-01-16T20:02:32.946ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 39de0ab7-8c61-46aa-88f2-d42db34dffb8, lookup_type: ById(39de0ab7-8c61-46aa-88f2-d42db34dffb8) } result = Ok(())
37992025-01-16T20:02:32.946ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38002025-01-16T20:02:32.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38012025-01-16T20:02:32.959ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 original_time_created = 2025-01-16 19:48:51.140214 UTC target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 time_created = 2025-01-16 19:48:51.140214 UTC
38022025-01-16T20:02:32.959ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 120.028686ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"39de0ab7-8c61-46aa-88f2-d42db34dffb8","time_created":"2025-01-16T19:48:51.140214Z"}
38032025-01-16T20:02:32.972ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38042025-01-16T20:02:32.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38052025-01-16T20:02:32.972ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f zone_address = fd00:1122:3344:101::2
38062025-01-16T20:02:32.972ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38072025-01-16T20:02:32.973ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa05d01a-c7fb-4e4a-b2d0-38dd16822072", "content-length": "26", "date": "Thu, 16 Jan 2025 20:02:32 GMT"} })
38082025-01-16T20:02:32.973ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38092025-01-16T20:02:32.974ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 26dc04a7-8537-47d8-965d-0931849f651f
38102025-01-16T20:02:32.977ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38112025-01-16T20:02:32.977ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
38122025-01-16T20:02:32.977ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 138.264266ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
38132025-01-16T20:02:32.998ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 159.061181ms iteration = 31 status = {"physical_disks_added":0}
38142025-01-16T20:02:33.008ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
38152025-01-16T20:02:33.008ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "18706d3c-719c-4f90-b2f8-0ddbcb455a52", "content-length": "2", "date": "Thu, 16 Jan 2025 20:02:32 GMT"} })
38162025-01-16T20:02:33.010ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38172025-01-16T20:02:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38182025-01-16T20:02:33.013ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 174.477962ms iteration = 28 status = null
38192025-01-16T20:02:33.018ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 179.030272ms iteration = 28 status = {}
38202025-01-16T20:02:33.053ZINFOnexus (BackgroundTasks): VPC route manager sled 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
38212025-01-16T20:02:33.053ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38222025-01-16T20:02:33.053ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "143a9239-b54e-434f-a417-ba124cae5f83", "content-length": "372", "date": "Thu, 16 Jan 2025 20:02:33 GMT"} })
38232025-01-16T20:02:33.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38242025-01-16T20:02:33.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38252025-01-16T20:02:33.068ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
38262025-01-16T20:02:33.068ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
38272025-01-16T20:02:33.068ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1181c8f1-b8c3-4bf5-a092-40feb038d4b5", "date": "Thu, 16 Jan 2025 20:02:33 GMT"} })
38282025-01-16T20:02:33.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38292025-01-16T20:02:33.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38302025-01-16T20:02:33.069ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38312025-01-16T20:02:33.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38322025-01-16T20:02:33.071ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38332025-01-16T20:02:33.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38342025-01-16T20:02:33.071ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38352025-01-16T20:02:33.073ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38362025-01-16T20:02:33.073ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38372025-01-16T20:02:33.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38382025-01-16T20:02:33.074ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38392025-01-16T20:02:33.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38402025-01-16T20:02:33.075ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38412025-01-16T20:02:33.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38422025-01-16T20:02:33.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38432025-01-16T20:02:33.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38442025-01-16T20:02:33.077ZINFOnexus (BackgroundTasks): VPC route manager sled 87207105-a825-4eaa-ac6d-6aaa586b0fc5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
38452025-01-16T20:02:33.077ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38462025-01-16T20:02:33.077ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a5238208-ee14-4e28-b0ef-287ae061f1d5", "date": "Thu, 16 Jan 2025 20:02:33 GMT"} })
38472025-01-16T20:02:33.079ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 240.187835ms iteration = 32 status = {}
38482025-01-16T20:02:33.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38492025-01-16T20:02:33.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38502025-01-16T20:02:33.112ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 6ec20bf0-03fa-4e36-9de7-54dd5e9cfde1, rack_id: 26dc04a7-8537-47d8-965d-0931849f651f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(438946af-d2bd-4eab-8036-57fe8293b9f9) } rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch_location = Switch0
38512025-01-16T20:02:33.112ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38522025-01-16T20:02:33.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38532025-01-16T20:02:33.121ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
38542025-01-16T20:02:33.121ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a26327e-e7bb-4721-ad35-6f8a93b81e61", "content-length": "134", "date": "Thu, 16 Jan 2025 20:02:32 GMT"} })
38552025-01-16T20:02:33.121ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
38562025-01-16T20:02:33.121ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 438946af-d2bd-4eab-8036-57fe8293b9f9
38572025-01-16T20:02:33.121ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
38582025-01-16T20:02:33.122ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38592025-01-16T20:02:33.122ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38602025-01-16T20:02:33.122ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38612025-01-16T20:02:33.122ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38622025-01-16T20:02:33.122ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38632025-01-16T20:02:33.122ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38642025-01-16T20:02:33.122ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38652025-01-16T20:02:33.122ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f
38662025-01-16T20:02:33.122ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38672025-01-16T20:02:33.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38682025-01-16T20:02:33.124ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
38692025-01-16T20:02:33.124ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e6e8423-e628-4c69-bf38-3c41d3311a41", "content-length": "2", "date": "Thu, 16 Jan 2025 20:02:32 GMT"} })
38702025-01-16T20:02:33.124ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
38712025-01-16T20:02:33.124ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3558ddb-0592-4537-a87f-f9d99002af9c", "content-length": "52", "date": "Thu, 16 Jan 2025 20:02:32 GMT"} })
38722025-01-16T20:02:33.124ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch_location = Switch0
38732025-01-16T20:02:33.125ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38742025-01-16T20:02:33.163ZDEBGnexus (BackgroundTasks): client request SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
38752025-01-16T20:02:33.211ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "138bd5c2-7c2a-4ea9-b143-36f7929dee6e", "date": "Thu, 16 Jan 2025 20:02:33 GMT"} })
38762025-01-16T20:02:33.211ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 26dc04a7-8537-47d8-965d-0931849f651f switch = Switch0
38772025-01-16T20:02:33.211ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 26dc04a7-8537-47d8-965d-0931849f651f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38782025-01-16T20:02:33.211ZDEBGnexus (BackgroundTasks): client response SledAgent = 87207105-a825-4eaa-ac6d-6aaa586b0fc5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "281f9d01-6275-4cb0-87b2-47c0bcf37a83", "content-length": "691", "date": "Thu, 16 Jan 2025 20:02:33 GMT"} })
38792025-01-16T20:02:33.211ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
38802025-01-16T20:02:33.211ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
38812025-01-16T20:02:33.211ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
38822025-01-16T20:02:33.211ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 26dc04a7-8537-47d8-965d-0931849f651f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c140b0cf-ec9f-4c95-a9c6-2f104ad193e4", "content-length": "682", "date": "Thu, 16 Jan 2025 20:02:32 GMT"} })
38832025-01-16T20:02:33.211ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38842025-01-16T20:02:33.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38852025-01-16T20:02:33.212ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 373.066376ms iteration = 30 status = {}
38862025-01-16T20:02:33.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38872025-01-16T20:02:33.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38882025-01-16T20:02:33.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38892025-01-16T20:02:33.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38902025-01-16T20:02:33.221ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38912025-01-16T20:02:33.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38922025-01-16T20:02:33.229ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 390.263248ms iteration = 28 status = {}
38932025-01-16T20:02:42.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 39065d62-e227-4168-be97-0cd0ec46e9d0 roles = RoleSet { roles: {} } uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?sort_by=id_ascending
38942025-01-16T20:02:42.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 39065d62-e227-4168-be97-0cd0ec46e9d0 resource = Database result = Ok(()) uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?sort_by=id_ascending
38952025-01-16T20:02:42.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2906 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 39065d62-e227-4168-be97-0cd0ec46e9d0 response_code = 200 uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?sort_by=id_ascending
38962025-01-16T20:02:42.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 679a8793-b698-4b0a-8c01-aa4f4b833601 roles = RoleSet { roles: {} } uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWFjMTliZS0yMzc3LTQyMDItYmQzYS0xNjEyMjBiMjRkNDAifX0%3D
38972025-01-16T20:02:42.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 679a8793-b698-4b0a-8c01-aa4f4b833601 resource = Database result = Ok(()) uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWFjMTliZS0yMzc3LTQyMDItYmQzYS0xNjEyMjBiMjRkNDAifX0%3D
38982025-01-16T20:02:42.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58311 req_id = 679a8793-b698-4b0a-8c01-aa4f4b833601 response_code = 200 uri = /metrics/collectors/d048ac10-211f-4354-a749-75b8d62cfaed/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZWFjMTliZS0yMzc3LTQyMDItYmQzYS0xNjEyMjBiMjRkNDAifX0%3D
38992025-01-16T20:02:42.685ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::c]:49474 method = GET remote_addr = [fd00:1122:3344:101::d]:39316 req_id = 0f5758b9-d482-4ae8-a4d8-eddbdbf6e612 response_code = 200 uri = /3c6582d4-0e42-407f-bc66-e913ef1c0f57
39002025-01-16T20:02:42.839ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
39012025-01-16T20:02:42.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39022025-01-16T20:02:42.839ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
39032025-01-16T20:02:42.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39042025-01-16T20:02:42.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39052025-01-16T20:02:42.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39062025-01-16T20:02:42.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39072025-01-16T20:02:42.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39082025-01-16T20:02:42.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39092025-01-16T20:02:42.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39102025-01-16T20:02:42.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39112025-01-16T20:02:42.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39122025-01-16T20:02:42.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39132025-01-16T20:02:42.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 39de0ab7-8c61-46aa-88f2-d42db34dffb8, lookup_type: ById(39de0ab7-8c61-46aa-88f2-d42db34dffb8) } result = Ok(())
39142025-01-16T20:02:42.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39152025-01-16T20:02:42.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39162025-01-16T20:02:42.861ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 original_time_created = 2025-01-16 19:48:51.140214 UTC target_id = 39de0ab7-8c61-46aa-88f2-d42db34dffb8 time_created = 2025-01-16 19:48:51.140214 UTC
39172025-01-16T20:02:42.861ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.070937ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"39de0ab7-8c61-46aa-88f2-d42db34dffb8","time_created":"2025-01-16T19:48:51.140214Z"}
39182025-01-16T20:02:42.869ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39192025-01-16T20:02:42.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39202025-01-16T20:02:42.871ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.952051ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}