Max level shown:
12024-12-20T22:30:01.100ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 527.925219ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
22024-12-20T22:30:01.100ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 527.770504ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32024-12-20T22:30:01.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42024-12-20T22:30:01.102ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
52024-12-20T22:30:01.102ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
62024-12-20T22:30:01.102ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72024-12-20T22:30:01.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82024-12-20T22:30:01.104ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92024-12-20T22:30:01.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102024-12-20T22:30:01.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
112024-12-20T22:30:01.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122024-12-20T22:30:01.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
132024-12-20T22:30:01.107ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 533.992306ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
142024-12-20T22:30:01.107ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
152024-12-20T22:30:01.107ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
162024-12-20T22:30:01.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
172024-12-20T22:30:01.108ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
182024-12-20T22:30:01.108ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
192024-12-20T22:30:01.108ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 535.872759ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
202024-12-20T22:30:01.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
212024-12-20T22:30:01.109ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
222024-12-20T22:30:01.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
232024-12-20T22:30:01.114ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
242024-12-20T22:30:01.114ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
252024-12-20T22:30:01.114ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:26:39.700273 UTC dns_group = internal generation = 1
262024-12-20T22:30:01.114ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 542.43785ms iteration = 5 status = {"generation":1}
272024-12-20T22:30:01.120ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
282024-12-20T22:30:01.122ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
292024-12-20T22:30:01.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
302024-12-20T22:30:01.125ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
312024-12-20T22:30:01.125ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
322024-12-20T22:30:01.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
332024-12-20T22:30:01.127ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
342024-12-20T22:30:01.127ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
352024-12-20T22:30:01.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
362024-12-20T22:30:01.129ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
372024-12-20T22:30:01.132ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
382024-12-20T22:30:01.132ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
392024-12-20T22:30:01.132ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "129ca8dd-7f46-4411-a937-a70142e8d131", "date": "Fri, 20 Dec 2024 22:30:01 GMT"} })
402024-12-20T22:30:01.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
412024-12-20T22:30:01.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
422024-12-20T22:30:01.132ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
432024-12-20T22:30:01.132ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
442024-12-20T22:30:01.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
452024-12-20T22:30:01.135ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
462024-12-20T22:30:01.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
472024-12-20T22:30:01.136ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
482024-12-20T22:30:01.137ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f7d56ae-2c43-4cd7-b04a-185ebc7f49cb", "content-length": "1", "date": "Fri, 20 Dec 2024 22:30:00 GMT"} })
492024-12-20T22:30:01.139ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
502024-12-20T22:30:01.139ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
512024-12-20T22:30:01.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
522024-12-20T22:30:01.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
532024-12-20T22:30:01.141ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 570.131414ms iteration = 9 status = null
542024-12-20T22:30:01.143ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
552024-12-20T22:30:01.143ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
562024-12-20T22:30:01.144ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "16c1e9b0-11cb-4e3f-8957-ddca9792191f", "date": "Fri, 20 Dec 2024 22:30:01 GMT"} })
572024-12-20T22:30:01.146ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 573.392894ms iteration = 9 status = {}
582024-12-20T22:30:01.172ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:25:57.040586Z, time_modified: 2024-12-20T22:25:57.040586Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }) }
592024-12-20T22:30:01.172ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 600.906173ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]}},"default_endpoint":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
602024-12-20T22:30:01.176ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
612024-12-20T22:30:01.177ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 0 version = 2
622024-12-20T22:30:01.177ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
632024-12-20T22:30:01.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
642024-12-20T22:30:01.178ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
652024-12-20T22:30:01.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
662024-12-20T22:30:01.182ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
672024-12-20T22:30:01.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
682024-12-20T22:30:01.185ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 1 version = 2
692024-12-20T22:30:01.185ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
702024-12-20T22:30:01.185ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:26:40.428768 UTC dns_group = external generation = 2
712024-12-20T22:30:01.185ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 613.415288ms iteration = 5 status = {"generation":2}
722024-12-20T22:30:01.196ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
732024-12-20T22:30:01.197ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ff5262a7-4eaa-4caa-bd4f-dafed5457789", "date": "Fri, 20 Dec 2024 22:30:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
742024-12-20T22:30:01.197ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
752024-12-20T22:30:01.198ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "11f42329-8279-4a43-ac84-91db839f75bd", "date": "Fri, 20 Dec 2024 22:30:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
762024-12-20T22:30:01.198ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
772024-12-20T22:30:01.200ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5e5a02b3-5646-4f92-836d-d1ca4756c894", "date": "Fri, 20 Dec 2024 22:30:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
782024-12-20T22:30:01.200ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
792024-12-20T22:30:01.202ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
802024-12-20T22:30:01.202ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 630.206211ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
812024-12-20T22:30:01.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 14593997-085e-4c80-afca-f83e2e37c2e7 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
822024-12-20T22:30:01.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 14593997-085e-4c80-afca-f83e2e37c2e7 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
832024-12-20T22:30:01.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2677 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 14593997-085e-4c80-afca-f83e2e37c2e7 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
842024-12-20T22:30:01.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
852024-12-20T22:30:01.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
862024-12-20T22:30:01.221ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
872024-12-20T22:30:01.221ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 648.135587ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
882024-12-20T22:30:01.222ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9fedf0d4-8a86-4506-bf93-224faabd5e37, rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b26f0563-25fb-4d7c-8480-dd368ac01105) } rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
892024-12-20T22:30:01.222ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
902024-12-20T22:30:01.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
912024-12-20T22:30:01.239ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
922024-12-20T22:30:01.239ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1768fd9c-24fc-4478-b03a-e4560e236c31", "content-length": "134", "date": "Fri, 20 Dec 2024 22:30:00 GMT"} })
932024-12-20T22:30:01.239ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
942024-12-20T22:30:01.239ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b26f0563-25fb-4d7c-8480-dd368ac01105
952024-12-20T22:30:01.240ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
962024-12-20T22:30:01.240ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
972024-12-20T22:30:01.240ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
982024-12-20T22:30:01.240ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
992024-12-20T22:30:01.240ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
1002024-12-20T22:30:01.240ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
1012024-12-20T22:30:01.240ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
1022024-12-20T22:30:01.240ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
1032024-12-20T22:30:01.240ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
1042024-12-20T22:30:01.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1052024-12-20T22:30:01.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1062024-12-20T22:30:01.254ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
1072024-12-20T22:30:01.254ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "46ad4a1b-cbeb-4615-a459-92555aa1d9b2", "content-length": "2", "date": "Fri, 20 Dec 2024 22:30:00 GMT"} })
1082024-12-20T22:30:01.254ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
1092024-12-20T22:30:01.254ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6bd5f21c-a247-4b22-8d98-7f088f523514", "content-length": "52", "date": "Fri, 20 Dec 2024 22:30:00 GMT"} })
1102024-12-20T22:30:01.254ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
1112024-12-20T22:30:01.254ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
1122024-12-20T22:30:01.272ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 699.587136ms iteration = 11 status = {"physical_disks_added":0}
1132024-12-20T22:30:01.276ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
1142024-12-20T22:30:01.391ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "84996a80-70b0-45f7-9b16-c0ad67e9a559", "date": "Fri, 20 Dec 2024 22:30:01 GMT"} })
1152024-12-20T22:30:01.391ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch = Switch0
1162024-12-20T22:30:01.391ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
1172024-12-20T22:30:01.392ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ad4dedf-6e71-43c0-a000-ef37dc5c4fae", "content-length": "691", "date": "Fri, 20 Dec 2024 22:30:01 GMT"} })
1182024-12-20T22:30:01.392ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
1192024-12-20T22:30:01.392ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
1202024-12-20T22:30:01.392ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
1212024-12-20T22:30:01.392ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6441cba2-7754-43cc-9fa0-614860f5cf33", "content-length": "682", "date": "Fri, 20 Dec 2024 22:30:01 GMT"} })
1222024-12-20T22:30:01.392ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1232024-12-20T22:30:01.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1242024-12-20T22:30:01.394ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 820.915755ms iteration = 9 status = {}
1252024-12-20T22:30:01.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1262024-12-20T22:30:01.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1272024-12-20T22:30:01.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1282024-12-20T22:30:01.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1292024-12-20T22:30:01.403ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1302024-12-20T22:30:01.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1312024-12-20T22:30:01.411ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 838.88784ms iteration = 9 status = {}
1322024-12-20T22:30:02.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4e54dd79-0541-457b-8700-64d4fa89e8ec roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1332024-12-20T22:30:02.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4e54dd79-0541-457b-8700-64d4fa89e8ec resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1342024-12-20T22:30:02.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4e54dd79-0541-457b-8700-64d4fa89e8ec response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1352024-12-20T22:30:03.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b126a301-13c0-488f-b7b0-a2a027bd4f8f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1362024-12-20T22:30:03.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b126a301-13c0-488f-b7b0-a2a027bd4f8f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1372024-12-20T22:30:03.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2729 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b126a301-13c0-488f-b7b0-a2a027bd4f8f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1382024-12-20T22:30:04.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6d1a6524-cb18-44cc-89c4-26544da65e04 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1392024-12-20T22:30:04.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6d1a6524-cb18-44cc-89c4-26544da65e04 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1402024-12-20T22:30:04.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2719 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6d1a6524-cb18-44cc-89c4-26544da65e04 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1412024-12-20T22:30:05.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 55c9a254-0ba7-4608-835d-1173600179c2 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1422024-12-20T22:30:05.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 55c9a254-0ba7-4608-835d-1173600179c2 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1432024-12-20T22:30:05.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2102 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 55c9a254-0ba7-4608-835d-1173600179c2 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1442024-12-20T22:30:05.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 0ad62984-9f56-4b8f-8082-c03c4b50be2a roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
1452024-12-20T22:30:05.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 0ad62984-9f56-4b8f-8082-c03c4b50be2a resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
1462024-12-20T22:30:05.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 0ad62984-9f56-4b8f-8082-c03c4b50be2a response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
1472024-12-20T22:30:05.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = eeb27d63-0abf-43e8-aac0-4dfe6a4eae4c roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
1482024-12-20T22:30:05.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = eeb27d63-0abf-43e8-aac0-4dfe6a4eae4c resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
1492024-12-20T22:30:05.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = eeb27d63-0abf-43e8-aac0-4dfe6a4eae4c response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
1502024-12-20T22:30:05.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 631 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 2936f9ab-2e5f-4afd-86ed-ea6a8fc246ed response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
1512024-12-20T22:30:06.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d6e40a4f-6b30-473e-915f-b58ddbdc4aee roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1522024-12-20T22:30:06.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d6e40a4f-6b30-473e-915f-b58ddbdc4aee resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1532024-12-20T22:30:06.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d6e40a4f-6b30-473e-915f-b58ddbdc4aee response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1542024-12-20T22:30:07.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 72a36eeb-0d37-49b1-9f86-1d7f156ef456 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1552024-12-20T22:30:07.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 72a36eeb-0d37-49b1-9f86-1d7f156ef456 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1562024-12-20T22:30:07.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2774 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 72a36eeb-0d37-49b1-9f86-1d7f156ef456 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1572024-12-20T22:30:08.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = dfa1e0ee-8435-4d6f-80c7-81573cdd7e73 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1582024-12-20T22:30:08.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = dfa1e0ee-8435-4d6f-80c7-81573cdd7e73 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1592024-12-20T22:30:08.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = dfa1e0ee-8435-4d6f-80c7-81573cdd7e73 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1602024-12-20T22:30:09.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 262e067a-8f66-49a3-8d6e-9acb3734b4f5 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1612024-12-20T22:30:09.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 262e067a-8f66-49a3-8d6e-9acb3734b4f5 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1622024-12-20T22:30:09.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1771 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 262e067a-8f66-49a3-8d6e-9acb3734b4f5 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1632024-12-20T22:30:10.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c92f040c-e1b4-486d-9686-cacd109e5aaf roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1642024-12-20T22:30:10.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c92f040c-e1b4-486d-9686-cacd109e5aaf resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1652024-12-20T22:30:10.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2102 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c92f040c-e1b4-486d-9686-cacd109e5aaf response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1662024-12-20T22:30:10.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
1672024-12-20T22:30:10.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1682024-12-20T22:30:10.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1692024-12-20T22:30:10.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
1702024-12-20T22:30:10.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1712024-12-20T22:30:10.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1722024-12-20T22:30:10.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1732024-12-20T22:30:10.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1742024-12-20T22:30:10.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1752024-12-20T22:30:10.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1762024-12-20T22:30:10.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1772024-12-20T22:30:10.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1782024-12-20T22:30:10.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1792024-12-20T22:30:10.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
1802024-12-20T22:30:10.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1812024-12-20T22:30:10.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1822024-12-20T22:30:10.595ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
1832024-12-20T22:30:10.595ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.215361ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
1842024-12-20T22:30:10.614ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1852024-12-20T22:30:10.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1862024-12-20T22:30:10.656ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 83.326339ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1872024-12-20T22:30:11.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3c6d762a-fbd1-4818-bb72-d633998f3124 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1882024-12-20T22:30:11.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3c6d762a-fbd1-4818-bb72-d633998f3124 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1892024-12-20T22:30:11.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3c6d762a-fbd1-4818-bb72-d633998f3124 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1902024-12-20T22:30:12.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 40e0c2ea-bced-429f-80ca-f0877f4fa25d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1912024-12-20T22:30:12.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 40e0c2ea-bced-429f-80ca-f0877f4fa25d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1922024-12-20T22:30:12.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2720 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 40e0c2ea-bced-429f-80ca-f0877f4fa25d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1932024-12-20T22:30:13.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5d05bac4-5a2a-48d3-859e-c0ae54dabcb9 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1942024-12-20T22:30:13.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5d05bac4-5a2a-48d3-859e-c0ae54dabcb9 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1952024-12-20T22:30:13.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5d05bac4-5a2a-48d3-859e-c0ae54dabcb9 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1962024-12-20T22:30:14.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5b02c1c9-6bf3-4a76-bcb8-40ffd1eda8f0 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1972024-12-20T22:30:14.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5b02c1c9-6bf3-4a76-bcb8-40ffd1eda8f0 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1982024-12-20T22:30:14.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5b02c1c9-6bf3-4a76-bcb8-40ffd1eda8f0 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
1992024-12-20T22:30:15.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 542 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 1c170e23-a575-4611-bbd3-76b2c83b2b9c response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
2002024-12-20T22:30:15.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d8fed33e-ccf5-408a-9c2b-8231284f7cf2 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2012024-12-20T22:30:15.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d8fed33e-ccf5-408a-9c2b-8231284f7cf2 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2022024-12-20T22:30:15.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d8fed33e-ccf5-408a-9c2b-8231284f7cf2 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2032024-12-20T22:30:16.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a839ddc7-f9f9-4d61-bdeb-0b6bd6e22864 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2042024-12-20T22:30:16.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a839ddc7-f9f9-4d61-bdeb-0b6bd6e22864 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2052024-12-20T22:30:16.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2438 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a839ddc7-f9f9-4d61-bdeb-0b6bd6e22864 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2062024-12-20T22:30:17.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7daf3060-14ce-4f7c-863b-b58e5945bd34 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2072024-12-20T22:30:17.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7daf3060-14ce-4f7c-863b-b58e5945bd34 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2082024-12-20T22:30:17.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7daf3060-14ce-4f7c-863b-b58e5945bd34 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2092024-12-20T22:30:18.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a837bfdd-b32e-439c-b876-fefd1fcf71a5 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2102024-12-20T22:30:18.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a837bfdd-b32e-439c-b876-fefd1fcf71a5 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2112024-12-20T22:30:18.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a837bfdd-b32e-439c-b876-fefd1fcf71a5 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2122024-12-20T22:30:19.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 705620f8-9b10-4100-b3ce-fd733c39398b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2132024-12-20T22:30:19.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 705620f8-9b10-4100-b3ce-fd733c39398b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2142024-12-20T22:30:19.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 705620f8-9b10-4100-b3ce-fd733c39398b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2152024-12-20T22:30:20.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
2162024-12-20T22:30:20.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2172024-12-20T22:30:20.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2182024-12-20T22:30:20.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
2192024-12-20T22:30:20.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2202024-12-20T22:30:20.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2212024-12-20T22:30:20.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2222024-12-20T22:30:20.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2232024-12-20T22:30:20.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2242024-12-20T22:30:20.575ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.858659ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2252024-12-20T22:30:20.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2262024-12-20T22:30:20.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2272024-12-20T22:30:20.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2282024-12-20T22:30:20.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2292024-12-20T22:30:20.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2302024-12-20T22:30:20.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2312024-12-20T22:30:20.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
2322024-12-20T22:30:20.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2332024-12-20T22:30:20.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2342024-12-20T22:30:20.595ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
2352024-12-20T22:30:20.595ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.644423ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
2362024-12-20T22:30:20.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = eac6237c-48d9-4637-9959-18017892ed59 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2372024-12-20T22:30:20.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = eac6237c-48d9-4637-9959-18017892ed59 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2382024-12-20T22:30:20.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = eac6237c-48d9-4637-9959-18017892ed59 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2392024-12-20T22:30:21.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e54e7490-035e-44ec-9dec-4591c1dc4818 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2402024-12-20T22:30:21.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e54e7490-035e-44ec-9dec-4591c1dc4818 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2412024-12-20T22:30:21.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e54e7490-035e-44ec-9dec-4591c1dc4818 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2422024-12-20T22:30:22.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = bfcc5350-fab7-49cf-93f0-d8a23a1e32dc roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2432024-12-20T22:30:22.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = bfcc5350-fab7-49cf-93f0-d8a23a1e32dc resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2442024-12-20T22:30:22.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = bfcc5350-fab7-49cf-93f0-d8a23a1e32dc response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2452024-12-20T22:30:23.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 758a7389-20fe-4e35-a7d1-16eb076872c8 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2462024-12-20T22:30:23.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 758a7389-20fe-4e35-a7d1-16eb076872c8 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2472024-12-20T22:30:23.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 758a7389-20fe-4e35-a7d1-16eb076872c8 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2482024-12-20T22:30:24.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 784c3c1b-93b7-4a14-9562-acc86afafcab roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2492024-12-20T22:30:24.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 784c3c1b-93b7-4a14-9562-acc86afafcab resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2502024-12-20T22:30:24.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1811 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 784c3c1b-93b7-4a14-9562-acc86afafcab response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2512024-12-20T22:30:25.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 541 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 74943aa5-bef8-421e-b556-34868b9d200e response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
2522024-12-20T22:30:25.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 475c46b2-7c78-4080-adaf-c26363566631 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2532024-12-20T22:30:25.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 475c46b2-7c78-4080-adaf-c26363566631 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2542024-12-20T22:30:25.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 475c46b2-7c78-4080-adaf-c26363566631 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2552024-12-20T22:30:26.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cae7c835-789b-44f3-ab94-3b5724e84971 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2562024-12-20T22:30:26.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cae7c835-789b-44f3-ab94-3b5724e84971 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2572024-12-20T22:30:26.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cae7c835-789b-44f3-ab94-3b5724e84971 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2582024-12-20T22:30:27.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0d87305a-38f0-45c3-898b-a412eb8c0c4b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2592024-12-20T22:30:27.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0d87305a-38f0-45c3-898b-a412eb8c0c4b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2602024-12-20T22:30:27.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0d87305a-38f0-45c3-898b-a412eb8c0c4b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2612024-12-20T22:30:28.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a1c8018a-f97a-41a2-b3fd-3eaf7e0c7066 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2622024-12-20T22:30:28.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a1c8018a-f97a-41a2-b3fd-3eaf7e0c7066 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2632024-12-20T22:30:28.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a1c8018a-f97a-41a2-b3fd-3eaf7e0c7066 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2642024-12-20T22:30:29.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 28228d25-5d57-42ef-a9c8-29cc319b781b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2652024-12-20T22:30:29.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 28228d25-5d57-42ef-a9c8-29cc319b781b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2662024-12-20T22:30:29.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1893 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 28228d25-5d57-42ef-a9c8-29cc319b781b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
2672024-12-20T22:30:30.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = ac543805-4f81-413f-baf9-b43d3b8cf4f2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
2682024-12-20T22:30:30.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = ac543805-4f81-413f-baf9-b43d3b8cf4f2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
2692024-12-20T22:30:30.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = ac543805-4f81-413f-baf9-b43d3b8cf4f2 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
2702024-12-20T22:30:30.571ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
2712024-12-20T22:30:30.571ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
2722024-12-20T22:30:30.571ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
2732024-12-20T22:30:30.571ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2742024-12-20T22:30:30.571ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
2752024-12-20T22:30:30.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
2762024-12-20T22:30:30.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2772024-12-20T22:30:30.571ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
2782024-12-20T22:30:30.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2792024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2802024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
2812024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
2822024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2832024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
2842024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2852024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
2862024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
2872024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2882024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2892024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
2902024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
2912024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2922024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
2932024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2942024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2952024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
2962024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2972024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
2982024-12-20T22:30:30.572ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
2992024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3002024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
3012024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3022024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
3032024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
3042024-12-20T22:30:30.572ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
3052024-12-20T22:30:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
3062024-12-20T22:30:30.573ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
3072024-12-20T22:30:30.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3082024-12-20T22:30:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
3092024-12-20T22:30:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3102024-12-20T22:30:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3112024-12-20T22:30:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3122024-12-20T22:30:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
3132024-12-20T22:30:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
3142024-12-20T22:30:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
3152024-12-20T22:30:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3162024-12-20T22:30:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
3172024-12-20T22:30:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3182024-12-20T22:30:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3192024-12-20T22:30:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3202024-12-20T22:30:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3212024-12-20T22:30:30.573ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 978, tv_nsec: 186477768 } })
3222024-12-20T22:30:30.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
3232024-12-20T22:30:30.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3242024-12-20T22:30:30.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 978, tv_nsec: 186935541 } })
3252024-12-20T22:30:30.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
3262024-12-20T22:30:30.574ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.762094ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
3272024-12-20T22:30:30.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3282024-12-20T22:30:30.577ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3292024-12-20T22:30:30.577ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
3302024-12-20T22:30:30.577ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3312024-12-20T22:30:30.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3322024-12-20T22:30:30.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3332024-12-20T22:30:30.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3342024-12-20T22:30:30.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3352024-12-20T22:30:30.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
3362024-12-20T22:30:30.578ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3372024-12-20T22:30:30.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3382024-12-20T22:30:30.579ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3392024-12-20T22:30:30.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3402024-12-20T22:30:30.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.647922ms iteration = 10 status = {"errors":[],"finish_invoked_ok":[]}
3412024-12-20T22:30:30.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
3422024-12-20T22:30:30.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
3432024-12-20T22:30:30.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
3442024-12-20T22:30:30.582ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3452024-12-20T22:30:30.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3462024-12-20T22:30:30.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3472024-12-20T22:30:30.583ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3482024-12-20T22:30:30.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3492024-12-20T22:30:30.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3502024-12-20T22:30:30.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3512024-12-20T22:30:30.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3522024-12-20T22:30:30.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3532024-12-20T22:30:30.587ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3542024-12-20T22:30:30.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3552024-12-20T22:30:30.588ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3562024-12-20T22:30:30.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3572024-12-20T22:30:30.625ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3582024-12-20T22:30:30.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3592024-12-20T22:30:30.628ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3602024-12-20T22:30:30.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3612024-12-20T22:30:30.630ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3622024-12-20T22:30:30.633ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3632024-12-20T22:30:30.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
3642024-12-20T22:30:30.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3652024-12-20T22:30:30.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3662024-12-20T22:30:30.635ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.751192ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
3672024-12-20T22:30:30.636ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 63.384579ms iteration = 10 status = 0
3682024-12-20T22:30:30.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
3692024-12-20T22:30:30.636ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3702024-12-20T22:30:30.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3712024-12-20T22:30:30.636ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
3722024-12-20T22:30:30.637ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
3732024-12-20T22:30:30.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
3742024-12-20T22:30:30.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
3752024-12-20T22:30:30.639ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 978, tv_nsec: 251979236 } })
3762024-12-20T22:30:30.639ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
3772024-12-20T22:30:30.641ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3782024-12-20T22:30:30.641ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
3792024-12-20T22:30:30.641ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3802024-12-20T22:30:30.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3812024-12-20T22:30:30.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3822024-12-20T22:30:30.644ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3832024-12-20T22:30:30.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3842024-12-20T22:30:30.646ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3852024-12-20T22:30:30.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3862024-12-20T22:30:30.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
3872024-12-20T22:30:30.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3882024-12-20T22:30:30.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3892024-12-20T22:30:30.647ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
3902024-12-20T22:30:30.647ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3912024-12-20T22:30:30.647ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3507e65-7201-4e04-aa47-c7007158b0cc", "content-length": "26", "date": "Fri, 20 Dec 2024 22:30:30 GMT"} })
3922024-12-20T22:30:30.647ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3932024-12-20T22:30:30.648ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.788221ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3942024-12-20T22:30:30.649ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3952024-12-20T22:30:30.651ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3962024-12-20T22:30:30.653ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
3972024-12-20T22:30:30.653ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3982024-12-20T22:30:30.653ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fe63485-3637-455c-9510-1db919634dd1", "content-length": "26", "date": "Fri, 20 Dec 2024 22:30:30 GMT"} })
3992024-12-20T22:30:30.653ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4002024-12-20T22:30:30.653ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
4012024-12-20T22:30:30.653ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4022024-12-20T22:30:30.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4032024-12-20T22:30:30.655ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4042024-12-20T22:30:30.655ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
4052024-12-20T22:30:30.656ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.118144ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
4062024-12-20T22:30:30.656ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4072024-12-20T22:30:30.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
4082024-12-20T22:30:30.660ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4092024-12-20T22:30:30.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4102024-12-20T22:30:30.661ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
4112024-12-20T22:30:30.661ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 89.445448ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
4122024-12-20T22:30:30.688ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 115.270852ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
4132024-12-20T22:30:30.694ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 121.300497ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
4142024-12-20T22:30:30.695ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4152024-12-20T22:30:30.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4162024-12-20T22:30:30.698ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
4172024-12-20T22:30:30.698ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
4182024-12-20T22:30:30.698ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 125.854023ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
4192024-12-20T22:30:30.718ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 145.214457ms iteration = 12 status = {"physical_disks_added":0}
4202024-12-20T22:30:30.736ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 zone_address = fd00:1122:3344:101::2
4212024-12-20T22:30:30.736ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4222024-12-20T22:30:30.736ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "da742279-fee8-4dab-80a1-d6cfe2ad6fbb", "content-length": "26", "date": "Fri, 20 Dec 2024 22:30:30 GMT"} })
4232024-12-20T22:30:30.737ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4242024-12-20T22:30:30.739ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
4252024-12-20T22:30:30.743ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4262024-12-20T22:30:30.743ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc4fe913-c2f8-40b1-9b9c-2e456d3cac6a", "content-length": "1", "date": "Fri, 20 Dec 2024 22:30:30 GMT"} })
4272024-12-20T22:30:30.743ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 170.791783ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
4282024-12-20T22:30:30.744ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4292024-12-20T22:30:30.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4302024-12-20T22:30:30.747ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 176.173532ms iteration = 10 status = null
4312024-12-20T22:30:30.751ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4322024-12-20T22:30:30.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4332024-12-20T22:30:30.753ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 181.848039ms iteration = 10 status = {}
4342024-12-20T22:30:30.791ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
4352024-12-20T22:30:30.791ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4362024-12-20T22:30:30.791ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6e4836a-10fe-42ec-a861-1e95400a1b9f", "content-length": "372", "date": "Fri, 20 Dec 2024 22:30:30 GMT"} })
4372024-12-20T22:30:30.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4382024-12-20T22:30:30.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4392024-12-20T22:30:30.800ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4402024-12-20T22:30:30.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4412024-12-20T22:30:30.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4422024-12-20T22:30:30.804ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4432024-12-20T22:30:30.804ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4442024-12-20T22:30:30.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4452024-12-20T22:30:30.806ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4462024-12-20T22:30:30.807ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4472024-12-20T22:30:30.807ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4482024-12-20T22:30:30.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4492024-12-20T22:30:30.844ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
4502024-12-20T22:30:30.844ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
4512024-12-20T22:30:30.844ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ec453bcc-6383-42dc-a1c3-14f722e66628", "date": "Fri, 20 Dec 2024 22:30:30 GMT"} })
4522024-12-20T22:30:30.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4532024-12-20T22:30:30.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4542024-12-20T22:30:30.846ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4552024-12-20T22:30:30.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4562024-12-20T22:30:30.847ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4572024-12-20T22:30:30.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4582024-12-20T22:30:30.849ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9fedf0d4-8a86-4506-bf93-224faabd5e37, rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b26f0563-25fb-4d7c-8480-dd368ac01105) } rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
4592024-12-20T22:30:30.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4602024-12-20T22:30:30.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4612024-12-20T22:30:30.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4622024-12-20T22:30:30.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4632024-12-20T22:30:30.855ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
4642024-12-20T22:30:30.855ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4652024-12-20T22:30:30.856ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d68886bb-b310-415f-b01f-c6737f1889fe", "date": "Fri, 20 Dec 2024 22:30:30 GMT"} })
4662024-12-20T22:30:30.857ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 284.650466ms iteration = 10 status = {}
4672024-12-20T22:30:30.860ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4682024-12-20T22:30:30.860ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "56fe5a58-a735-412c-ae59-64087d7c7f54", "content-length": "134", "date": "Fri, 20 Dec 2024 22:30:30 GMT"} })
4692024-12-20T22:30:30.860ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
4702024-12-20T22:30:30.860ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b26f0563-25fb-4d7c-8480-dd368ac01105
4712024-12-20T22:30:30.860ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
4722024-12-20T22:30:30.860ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
4732024-12-20T22:30:30.860ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4742024-12-20T22:30:30.860ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4752024-12-20T22:30:30.860ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4762024-12-20T22:30:30.860ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4772024-12-20T22:30:30.860ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4782024-12-20T22:30:30.860ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4792024-12-20T22:30:30.861ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
4802024-12-20T22:30:30.861ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4812024-12-20T22:30:30.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4822024-12-20T22:30:30.863ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
4832024-12-20T22:30:30.863ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a93344e9-e7b8-4484-ab24-47c657f4c1d6", "content-length": "2", "date": "Fri, 20 Dec 2024 22:30:30 GMT"} })
4842024-12-20T22:30:30.863ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
4852024-12-20T22:30:30.863ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "df53cbbe-6468-42d8-8c34-392c6453da18", "content-length": "52", "date": "Fri, 20 Dec 2024 22:30:30 GMT"} })
4862024-12-20T22:30:30.863ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
4872024-12-20T22:30:30.863ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
4882024-12-20T22:30:30.913ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
4892024-12-20T22:30:30.954ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "42719039-1818-448c-89c2-47c7c74f2750", "date": "Fri, 20 Dec 2024 22:30:30 GMT"} })
4902024-12-20T22:30:30.954ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch = Switch0
4912024-12-20T22:30:30.954ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
4922024-12-20T22:30:30.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8f886635-32e3-40ca-9b4e-6fad2fd777d2 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
4932024-12-20T22:30:30.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8f886635-32e3-40ca-9b4e-6fad2fd777d2 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
4942024-12-20T22:30:30.954ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "741ff829-6486-46bb-a7ec-5cbeef82a43c", "content-length": "691", "date": "Fri, 20 Dec 2024 22:30:30 GMT"} })
4952024-12-20T22:30:30.954ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "db4247b5-201f-421c-94c1-3b75ad7959dd", "content-length": "682", "date": "Fri, 20 Dec 2024 22:30:30 GMT"} })
4962024-12-20T22:30:30.954ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
4972024-12-20T22:30:30.954ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
4982024-12-20T22:30:30.954ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
4992024-12-20T22:30:30.954ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5002024-12-20T22:30:30.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5012024-12-20T22:30:30.955ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 382.708881ms iteration = 10 status = {}
5022024-12-20T22:30:30.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8f886635-32e3-40ca-9b4e-6fad2fd777d2 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5032024-12-20T22:30:30.958ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5042024-12-20T22:30:30.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5052024-12-20T22:30:30.962ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5062024-12-20T22:30:30.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5072024-12-20T22:30:30.964ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5082024-12-20T22:30:30.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5092024-12-20T22:30:30.972ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 399.33877ms iteration = 10 status = {}
5102024-12-20T22:30:31.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f6d11c2c-818d-4c72-aee4-0f0be598d5f1 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5112024-12-20T22:30:31.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f6d11c2c-818d-4c72-aee4-0f0be598d5f1 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5122024-12-20T22:30:31.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f6d11c2c-818d-4c72-aee4-0f0be598d5f1 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5132024-12-20T22:30:32.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2ca77c0b-e1b2-48b1-aa00-0017bfc44bcb roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5142024-12-20T22:30:32.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2ca77c0b-e1b2-48b1-aa00-0017bfc44bcb resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5152024-12-20T22:30:32.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2ca77c0b-e1b2-48b1-aa00-0017bfc44bcb response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5162024-12-20T22:30:34.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e4597a41-b58a-48b5-84ac-74a26eb40a6b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5172024-12-20T22:30:34.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e4597a41-b58a-48b5-84ac-74a26eb40a6b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5182024-12-20T22:30:34.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e4597a41-b58a-48b5-84ac-74a26eb40a6b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5192024-12-20T22:30:35.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 379e3c3a-c2e2-4e01-9243-905dc047097b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5202024-12-20T22:30:35.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 379e3c3a-c2e2-4e01-9243-905dc047097b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5212024-12-20T22:30:35.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2806 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 379e3c3a-c2e2-4e01-9243-905dc047097b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5222024-12-20T22:30:35.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 630 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 9e8fbee3-ec0c-45c6-8eac-d59bd96cec6f response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
5232024-12-20T22:30:36.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 185d02d2-d745-4225-be43-33e95a5e343b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5242024-12-20T22:30:36.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 185d02d2-d745-4225-be43-33e95a5e343b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5252024-12-20T22:30:36.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 185d02d2-d745-4225-be43-33e95a5e343b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5262024-12-20T22:30:37.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0fea2d1d-df79-4c10-b728-344a94cfd4c9 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5272024-12-20T22:30:37.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0fea2d1d-df79-4c10-b728-344a94cfd4c9 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5282024-12-20T22:30:37.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0fea2d1d-df79-4c10-b728-344a94cfd4c9 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5292024-12-20T22:30:38.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1c8cb36c-3434-4e7e-aa23-756d29dd3a42 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5302024-12-20T22:30:38.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1c8cb36c-3434-4e7e-aa23-756d29dd3a42 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5312024-12-20T22:30:38.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1c8cb36c-3434-4e7e-aa23-756d29dd3a42 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5322024-12-20T22:30:39.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d65ca743-f73d-4ce0-ad14-57ef776a3ba9 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5332024-12-20T22:30:39.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d65ca743-f73d-4ce0-ad14-57ef776a3ba9 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5342024-12-20T22:30:39.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d65ca743-f73d-4ce0-ad14-57ef776a3ba9 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5352024-12-20T22:30:40.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = aee59aa1-96ea-4956-a15b-388e2d740afa roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5362024-12-20T22:30:40.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = aee59aa1-96ea-4956-a15b-388e2d740afa resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5372024-12-20T22:30:40.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = aee59aa1-96ea-4956-a15b-388e2d740afa response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5382024-12-20T22:30:40.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
5392024-12-20T22:30:40.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5402024-12-20T22:30:40.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5412024-12-20T22:30:40.572ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
5422024-12-20T22:30:40.572ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5432024-12-20T22:30:40.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5442024-12-20T22:30:40.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5452024-12-20T22:30:40.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5462024-12-20T22:30:40.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5472024-12-20T22:30:40.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5482024-12-20T22:30:40.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5492024-12-20T22:30:40.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5502024-12-20T22:30:40.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5512024-12-20T22:30:40.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
5522024-12-20T22:30:40.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5532024-12-20T22:30:40.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5542024-12-20T22:30:40.598ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
5552024-12-20T22:30:40.598ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.252285ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
5562024-12-20T22:30:40.617ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5572024-12-20T22:30:40.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5582024-12-20T22:30:40.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 86.086246ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5592024-12-20T22:30:41.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a26505bf-c3a6-4937-9f9d-c55107f90379 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5602024-12-20T22:30:41.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a26505bf-c3a6-4937-9f9d-c55107f90379 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5612024-12-20T22:30:41.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a26505bf-c3a6-4937-9f9d-c55107f90379 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5622024-12-20T22:30:42.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8bdb52d4-0941-4d00-bd47-d83bb470792e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5632024-12-20T22:30:42.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8bdb52d4-0941-4d00-bd47-d83bb470792e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5642024-12-20T22:30:42.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1698 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8bdb52d4-0941-4d00-bd47-d83bb470792e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5652024-12-20T22:30:43.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6a7b7d43-27ce-4714-86d2-9e683112c329 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5662024-12-20T22:30:43.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6a7b7d43-27ce-4714-86d2-9e683112c329 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5672024-12-20T22:30:43.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1789 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6a7b7d43-27ce-4714-86d2-9e683112c329 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5682024-12-20T22:30:44.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = be2d0462-7ba6-4f39-b6a5-65a27a66ebc2 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5692024-12-20T22:30:44.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = be2d0462-7ba6-4f39-b6a5-65a27a66ebc2 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5702024-12-20T22:30:44.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = be2d0462-7ba6-4f39-b6a5-65a27a66ebc2 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5712024-12-20T22:30:45.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 49afff88-d7e0-4891-9c7f-6ce65b6dd3ad roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5722024-12-20T22:30:45.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 49afff88-d7e0-4891-9c7f-6ce65b6dd3ad resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5732024-12-20T22:30:45.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 49afff88-d7e0-4891-9c7f-6ce65b6dd3ad response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5742024-12-20T22:30:45.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 727 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 88ca716d-4d8e-46c0-a0aa-6bfe34c9422f response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
5752024-12-20T22:30:46.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2bd379aa-00fb-4f97-809f-81b99c5dc358 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5762024-12-20T22:30:46.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2bd379aa-00fb-4f97-809f-81b99c5dc358 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5772024-12-20T22:30:46.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2bd379aa-00fb-4f97-809f-81b99c5dc358 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5782024-12-20T22:30:47.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3eaa80bd-8ece-4d36-9656-f68e90cea5de roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5792024-12-20T22:30:47.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3eaa80bd-8ece-4d36-9656-f68e90cea5de resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5802024-12-20T22:30:47.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1785 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3eaa80bd-8ece-4d36-9656-f68e90cea5de response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5812024-12-20T22:30:48.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0c979303-8ac6-4b52-981f-5892fd46c4b6 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5822024-12-20T22:30:48.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0c979303-8ac6-4b52-981f-5892fd46c4b6 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5832024-12-20T22:30:48.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0c979303-8ac6-4b52-981f-5892fd46c4b6 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5842024-12-20T22:30:49.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4d235795-f0e1-4a4a-ac5e-0aae46ecf2da roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5852024-12-20T22:30:49.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4d235795-f0e1-4a4a-ac5e-0aae46ecf2da resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5862024-12-20T22:30:49.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4d235795-f0e1-4a4a-ac5e-0aae46ecf2da response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5872024-12-20T22:30:50.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 30cd2e39-cc4f-47be-8558-e8337f9d06c2 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5882024-12-20T22:30:50.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 30cd2e39-cc4f-47be-8558-e8337f9d06c2 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5892024-12-20T22:30:50.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 30cd2e39-cc4f-47be-8558-e8337f9d06c2 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
5902024-12-20T22:30:50.571ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
5912024-12-20T22:30:50.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5922024-12-20T22:30:50.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5932024-12-20T22:30:50.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
5942024-12-20T22:30:50.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5952024-12-20T22:30:50.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5962024-12-20T22:30:50.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5972024-12-20T22:30:50.617ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5982024-12-20T22:30:50.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5992024-12-20T22:30:50.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6002024-12-20T22:30:50.619ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6012024-12-20T22:30:50.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6022024-12-20T22:30:50.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6032024-12-20T22:30:50.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6042024-12-20T22:30:50.624ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6052024-12-20T22:30:50.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
6062024-12-20T22:30:50.626ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6072024-12-20T22:30:50.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6082024-12-20T22:30:50.639ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
6092024-12-20T22:30:50.639ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.387529ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
6102024-12-20T22:30:50.658ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 85.384987ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6112024-12-20T22:30:51.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f4304b23-3f40-4f66-828d-3153cdbd55cb roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6122024-12-20T22:30:51.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f4304b23-3f40-4f66-828d-3153cdbd55cb resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6132024-12-20T22:30:51.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f4304b23-3f40-4f66-828d-3153cdbd55cb response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6142024-12-20T22:30:52.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1dbd94a0-8bd3-4a4b-8c08-d0aa4b106a87 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6152024-12-20T22:30:52.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1dbd94a0-8bd3-4a4b-8c08-d0aa4b106a87 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6162024-12-20T22:30:52.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1dbd94a0-8bd3-4a4b-8c08-d0aa4b106a87 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6172024-12-20T22:30:53.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a671c215-fbc1-480c-9fe8-a614c14c563c roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6182024-12-20T22:30:53.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a671c215-fbc1-480c-9fe8-a614c14c563c resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6192024-12-20T22:30:53.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a671c215-fbc1-480c-9fe8-a614c14c563c response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6202024-12-20T22:30:54.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f0f39cdb-2857-421e-b022-e224dedd76a6 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6212024-12-20T22:30:54.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f0f39cdb-2857-421e-b022-e224dedd76a6 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6222024-12-20T22:30:54.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f0f39cdb-2857-421e-b022-e224dedd76a6 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6232024-12-20T22:30:55.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 622 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 3f45dac6-50c7-49ac-8086-afb80e205de2 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
6242024-12-20T22:30:55.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0911d4b9-7ccb-45f2-9588-0650acca663c roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6252024-12-20T22:30:55.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0911d4b9-7ccb-45f2-9588-0650acca663c resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6262024-12-20T22:30:55.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0911d4b9-7ccb-45f2-9588-0650acca663c response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6272024-12-20T22:30:56.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0208397d-5a7f-4ca0-ac96-195dd915f966 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6282024-12-20T22:30:56.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0208397d-5a7f-4ca0-ac96-195dd915f966 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6292024-12-20T22:30:56.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0208397d-5a7f-4ca0-ac96-195dd915f966 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6302024-12-20T22:30:57.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3db7e3ec-ed63-4b1f-b024-55f34fdb5276 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6312024-12-20T22:30:57.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3db7e3ec-ed63-4b1f-b024-55f34fdb5276 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6322024-12-20T22:30:57.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2607 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3db7e3ec-ed63-4b1f-b024-55f34fdb5276 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6332024-12-20T22:30:58.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 708cf4f0-1635-4fc0-9c4e-651840a4d4eb roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6342024-12-20T22:30:58.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 708cf4f0-1635-4fc0-9c4e-651840a4d4eb resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6352024-12-20T22:30:58.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 708cf4f0-1635-4fc0-9c4e-651840a4d4eb response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6362024-12-20T22:30:59.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4227859f-09a6-402b-a210-6cafdc33654c roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6372024-12-20T22:30:59.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4227859f-09a6-402b-a210-6cafdc33654c resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6382024-12-20T22:30:59.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4889 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4227859f-09a6-402b-a210-6cafdc33654c response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
6392024-12-20T22:31:00.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 6fbe23c9-d18b-44c5-acc9-a3f44e02af0a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
6402024-12-20T22:31:00.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 6fbe23c9-d18b-44c5-acc9-a3f44e02af0a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
6412024-12-20T22:31:00.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 6fbe23c9-d18b-44c5-acc9-a3f44e02af0a response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
6422024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
6432024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
6442024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6452024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6462024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
6472024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
6482024-12-20T22:31:00.571ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:21:00.571342783 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
6492024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
6502024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
6512024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6522024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
6532024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
6542024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
6552024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
6562024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6572024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
6582024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
6592024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
6602024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6612024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
6622024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
6632024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6642024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
6652024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6662024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6672024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6682024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
6692024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
6702024-12-20T22:31:00.571ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e
6712024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6722024-12-20T22:31:00.571ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.351\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e"}
6732024-12-20T22:31:00.572ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bcf7579-f08c-458a-b8fa-486beafab77e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c65750e1-e505-4d05-b242-145c69974016.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c65750e1-e505-4d05-b242-145c69974016.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1008, tv_nsec: 184480573 } })
6742024-12-20T22:31:00.572ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b172144-6fe3-403a-b88e-6be93db6788c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e1e925bb-4266-49d2-b532-0f79860badbb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9d7e78a-d944-4f23-9be0-86e0f1334a43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9d7e78a-d944-4f23-9be0-86e0f1334a43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1008, tv_nsec: 184563785 } })
6752024-12-20T22:31:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6762024-12-20T22:31:00.572ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
6772024-12-20T22:31:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.1219ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
6782024-12-20T22:31:00.572ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
6792024-12-20T22:31:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.242674ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
6802024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
6812024-12-20T22:31:00.573ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
6822024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
6832024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6842024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
6852024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
6862024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
6872024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
6882024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6892024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
6902024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
6912024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
6922024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6932024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
6942024-12-20T22:31:00.573ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
6952024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6962024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
6972024-12-20T22:31:00.573ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
6982024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
6992024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7002024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7012024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
7022024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7032024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
7042024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
7052024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
7062024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7072024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
7082024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
7092024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7102024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
7112024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7122024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
7132024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
7142024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
7152024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7162024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
7172024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7182024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
7192024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
7202024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
7212024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
7222024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7232024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7242024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7252024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7262024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7272024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7282024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
7292024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
7302024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7312024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7322024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7332024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7342024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
7352024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7362024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7372024-12-20T22:31:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
7382024-12-20T22:31:00.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1008, tv_nsec: 186899610 } })
7392024-12-20T22:31:00.574ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7402024-12-20T22:31:00.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
7412024-12-20T22:31:00.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7422024-12-20T22:31:00.574ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.437244ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
7432024-12-20T22:31:00.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7442024-12-20T22:31:00.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7452024-12-20T22:31:00.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7462024-12-20T22:31:00.575ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:21:00.571342783 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
7472024-12-20T22:31:00.575ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.292298ms iteration = 6 status = {"expiration":"2024-12-20T22:21:00.571342783Z","pruned":[]}
7482024-12-20T22:31:00.575ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1008, tv_nsec: 188278088 } })
7492024-12-20T22:31:00.576ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
7502024-12-20T22:31:00.576ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
7512024-12-20T22:31:00.576ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7522024-12-20T22:31:00.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7532024-12-20T22:31:00.578ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7542024-12-20T22:31:00.579ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 6.130729ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
7552024-12-20T22:31:00.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7562024-12-20T22:31:00.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7572024-12-20T22:31:00.580ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7582024-12-20T22:31:00.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7592024-12-20T22:31:00.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
7602024-12-20T22:31:00.581ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
7612024-12-20T22:31:00.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
7622024-12-20T22:31:00.582ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7632024-12-20T22:31:00.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7642024-12-20T22:31:00.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
7652024-12-20T22:31:00.585ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7662024-12-20T22:31:00.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7672024-12-20T22:31:00.586ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7682024-12-20T22:31:00.586ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7692024-12-20T22:31:00.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7702024-12-20T22:31:00.587ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7712024-12-20T22:31:00.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7722024-12-20T22:31:00.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7732024-12-20T22:31:00.591ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7742024-12-20T22:31:00.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7752024-12-20T22:31:00.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
7762024-12-20T22:31:00.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7772024-12-20T22:31:00.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7782024-12-20T22:31:00.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 44d4c087-9cb3-41eb-b8f6-a30a145024bc roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
7792024-12-20T22:31:00.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 44d4c087-9cb3-41eb-b8f6-a30a145024bc resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
7802024-12-20T22:31:00.599ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7812024-12-20T22:31:00.600ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7822024-12-20T22:31:00.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7832024-12-20T22:31:00.602ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7842024-12-20T22:31:00.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7852024-12-20T22:31:00.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7862024-12-20T22:31:00.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7872024-12-20T22:31:00.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7882024-12-20T22:31:00.608ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7892024-12-20T22:31:00.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7902024-12-20T22:31:00.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 44d4c087-9cb3-41eb-b8f6-a30a145024bc response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
7912024-12-20T22:31:00.612ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7922024-12-20T22:31:00.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
7932024-12-20T22:31:00.615ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7942024-12-20T22:31:00.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7952024-12-20T22:31:00.618ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7962024-12-20T22:31:00.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7972024-12-20T22:31:00.653ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7982024-12-20T22:31:00.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7992024-12-20T22:31:00.654ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8002024-12-20T22:31:00.656ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8012024-12-20T22:31:00.657ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8022024-12-20T22:31:00.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8032024-12-20T22:31:00.657ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8042024-12-20T22:31:00.657ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
8052024-12-20T22:31:00.657ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8062024-12-20T22:31:00.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8072024-12-20T22:31:00.658ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8082024-12-20T22:31:00.660ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
8092024-12-20T22:31:00.660ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
8102024-12-20T22:31:00.660ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 86.970271ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
8112024-12-20T22:31:00.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8122024-12-20T22:31:00.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8132024-12-20T22:31:00.660ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8142024-12-20T22:31:00.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8152024-12-20T22:31:00.660ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
8162024-12-20T22:31:00.660ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
8172024-12-20T22:31:00.660ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 87.36872ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
8182024-12-20T22:31:00.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8192024-12-20T22:31:00.660ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 87.503745ms iteration = 11 status = {"errors":[],"finish_invoked_ok":[]}
8202024-12-20T22:31:00.662ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8212024-12-20T22:31:00.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8222024-12-20T22:31:00.666ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 93.247323ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8232024-12-20T22:31:00.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8242024-12-20T22:31:00.667ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
8252024-12-20T22:31:00.669ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
8262024-12-20T22:31:00.670ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 96.655967ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
8272024-12-20T22:31:00.670ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 96.941375ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
8282024-12-20T22:31:00.670ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
8292024-12-20T22:31:00.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
8302024-12-20T22:31:00.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8312024-12-20T22:31:00.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8322024-12-20T22:31:00.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
8332024-12-20T22:31:00.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 99.128176ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
8342024-12-20T22:31:00.672ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8352024-12-20T22:31:00.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8362024-12-20T22:31:00.674ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8372024-12-20T22:31:00.675ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8382024-12-20T22:31:00.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8392024-12-20T22:31:00.676ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8402024-12-20T22:31:00.676ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8412024-12-20T22:31:00.677ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
8422024-12-20T22:31:00.677ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
8432024-12-20T22:31:00.677ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
8442024-12-20T22:31:00.677ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8452024-12-20T22:31:00.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
8462024-12-20T22:31:00.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8472024-12-20T22:31:00.677ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8482024-12-20T22:31:00.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8492024-12-20T22:31:00.678ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
8502024-12-20T22:31:00.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
8512024-12-20T22:31:00.679ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8522024-12-20T22:31:00.679ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8532024-12-20T22:31:00.680ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8542024-12-20T22:31:00.680ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8552024-12-20T22:31:00.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
8562024-12-20T22:31:00.681ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8572024-12-20T22:31:00.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8582024-12-20T22:31:00.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8592024-12-20T22:31:00.681ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1008, tv_nsec: 293950394 } })
8602024-12-20T22:31:00.681ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
8612024-12-20T22:31:00.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
8622024-12-20T22:31:00.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8632024-12-20T22:31:00.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8642024-12-20T22:31:00.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
8652024-12-20T22:31:00.685ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
8662024-12-20T22:31:00.685ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 113.342868ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
8672024-12-20T22:31:00.685ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 112.040323ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8682024-12-20T22:31:00.686ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 112.911016ms iteration = 11 status = 0
8692024-12-20T22:31:00.697ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
8702024-12-20T22:31:00.697ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8712024-12-20T22:31:00.697ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b00270bc-60f1-4bdb-bf98-d274986c86b6", "content-length": "26", "date": "Fri, 20 Dec 2024 22:31:00 GMT"} })
8722024-12-20T22:31:00.697ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8732024-12-20T22:31:00.698ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
8742024-12-20T22:31:00.699ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8752024-12-20T22:31:00.704ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
8762024-12-20T22:31:00.704ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8772024-12-20T22:31:00.704ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "09a1ac86-91ce-481a-b550-30bf05892b7d", "content-length": "26", "date": "Fri, 20 Dec 2024 22:31:00 GMT"} })
8782024-12-20T22:31:00.704ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8792024-12-20T22:31:00.709ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8802024-12-20T22:31:00.714ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8812024-12-20T22:31:00.714ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 141.382192ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8822024-12-20T22:31:00.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8832024-12-20T22:31:00.716ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8842024-12-20T22:31:00.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8852024-12-20T22:31:00.716ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8862024-12-20T22:31:00.718ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
8872024-12-20T22:31:00.718ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8882024-12-20T22:31:00.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8892024-12-20T22:31:00.719ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8902024-12-20T22:31:00.719ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
8912024-12-20T22:31:00.719ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8922024-12-20T22:31:00.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8932024-12-20T22:31:00.720ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8942024-12-20T22:31:00.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8952024-12-20T22:31:00.721ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8962024-12-20T22:31:00.724ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
8972024-12-20T22:31:00.724ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8982024-12-20T22:31:00.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8992024-12-20T22:31:00.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
9002024-12-20T22:31:00.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
9012024-12-20T22:31:00.726ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9022024-12-20T22:31:00.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9032024-12-20T22:31:00.728ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9042024-12-20T22:31:00.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9052024-12-20T22:31:00.729ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
9062024-12-20T22:31:00.729ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
9072024-12-20T22:31:00.729ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
9082024-12-20T22:31:00.729ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9092024-12-20T22:31:00.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9102024-12-20T22:31:00.730ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9112024-12-20T22:31:00.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9122024-12-20T22:31:00.730ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
9132024-12-20T22:31:00.730ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
9142024-12-20T22:31:00.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
9152024-12-20T22:31:00.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
9162024-12-20T22:31:00.732ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9172024-12-20T22:31:00.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
9182024-12-20T22:31:00.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9192024-12-20T22:31:00.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
9202024-12-20T22:31:00.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
9212024-12-20T22:31:00.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9222024-12-20T22:31:00.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
9232024-12-20T22:31:00.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
9242024-12-20T22:31:00.737ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9252024-12-20T22:31:00.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9262024-12-20T22:31:00.741ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9272024-12-20T22:31:00.741ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
9282024-12-20T22:31:00.741ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
9292024-12-20T22:31:00.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9302024-12-20T22:31:00.741ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:26:39.700273 UTC dns_group = internal generation = 1
9312024-12-20T22:31:00.741ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 170.496665ms iteration = 6 status = {"generation":1}
9322024-12-20T22:31:00.743ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9332024-12-20T22:31:00.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9342024-12-20T22:31:00.745ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9352024-12-20T22:31:00.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9362024-12-20T22:31:00.747ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9372024-12-20T22:31:00.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9382024-12-20T22:31:00.748ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9392024-12-20T22:31:00.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9402024-12-20T22:31:00.782ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9412024-12-20T22:31:00.782ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
9422024-12-20T22:31:00.782ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 209.297676ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
9432024-12-20T22:31:00.785ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9442024-12-20T22:31:00.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9452024-12-20T22:31:00.792ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
9462024-12-20T22:31:00.792ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 0 version = 2
9472024-12-20T22:31:00.792ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9482024-12-20T22:31:00.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9492024-12-20T22:31:00.796ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:25:57.040586Z, time_modified: 2024-12-20T22:25:57.040586Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }) }
9502024-12-20T22:31:00.796ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 225.434311ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]}},"default_endpoint":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
9512024-12-20T22:31:00.798ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9522024-12-20T22:31:00.800ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9532024-12-20T22:31:00.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9542024-12-20T22:31:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
9552024-12-20T22:31:00.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9562024-12-20T22:31:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9572024-12-20T22:31:00.804ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9582024-12-20T22:31:00.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9592024-12-20T22:31:00.823ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 250.255806ms iteration = 13 status = {"physical_disks_added":0}
9602024-12-20T22:31:00.830ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
9612024-12-20T22:31:00.830ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ee07bd59-b02b-4244-85e8-ec4be70b9508", "date": "Fri, 20 Dec 2024 22:31:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
9622024-12-20T22:31:00.830ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
9632024-12-20T22:31:00.833ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8e0cf02c-5901-4c73-8332-d1ff6f126d89", "date": "Fri, 20 Dec 2024 22:31:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
9642024-12-20T22:31:00.833ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
9652024-12-20T22:31:00.836ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
9662024-12-20T22:31:00.836ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 264.962352ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
9672024-12-20T22:31:00.846ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 zone_address = fd00:1122:3344:101::2
9682024-12-20T22:31:00.846ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
9692024-12-20T22:31:00.846ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f3e1150-ab07-4fe7-9a90-b158387a4d7d", "content-length": "26", "date": "Fri, 20 Dec 2024 22:31:00 GMT"} })
9702024-12-20T22:31:00.846ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
9712024-12-20T22:31:00.848ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
9722024-12-20T22:31:00.868ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
9732024-12-20T22:31:00.868ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 295.305499ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
9742024-12-20T22:31:00.889ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
9752024-12-20T22:31:00.973ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
9762024-12-20T22:31:00.973ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f6c918c-a417-4a72-b348-561fefc35fb3", "content-length": "1", "date": "Fri, 20 Dec 2024 22:31:00 GMT"} })
9772024-12-20T22:31:00.975ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9782024-12-20T22:31:00.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9792024-12-20T22:31:00.984ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 412.949636ms iteration = 11 status = {}
9802024-12-20T22:31:01.064ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
9812024-12-20T22:31:01.064ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9822024-12-20T22:31:01.065ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b97d10fa-1cc6-4299-9a77-8f0b3f7a7acd", "content-length": "372", "date": "Fri, 20 Dec 2024 22:31:00 GMT"} })
9832024-12-20T22:31:01.065ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9842024-12-20T22:31:01.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9852024-12-20T22:31:01.066ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9862024-12-20T22:31:01.067ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9872024-12-20T22:31:01.067ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 1 version = 2
9882024-12-20T22:31:01.067ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
9892024-12-20T22:31:01.067ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:26:40.428768 UTC dns_group = external generation = 2
9902024-12-20T22:31:01.067ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 496.041799ms iteration = 6 status = {"generation":2}
9912024-12-20T22:31:01.068ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 496.965565ms iteration = 11 status = null
9922024-12-20T22:31:01.069ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9932024-12-20T22:31:01.069ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9942024-12-20T22:31:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9952024-12-20T22:31:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
9962024-12-20T22:31:01.070ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9972024-12-20T22:31:01.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9982024-12-20T22:31:01.072ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9992024-12-20T22:31:01.072ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10002024-12-20T22:31:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10012024-12-20T22:31:01.074ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10022024-12-20T22:31:01.074ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10032024-12-20T22:31:01.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10042024-12-20T22:31:01.074ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
10052024-12-20T22:31:01.075ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10062024-12-20T22:31:01.075ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ffb018a4-1300-4bd5-b194-44add6444fc1", "date": "Fri, 20 Dec 2024 22:31:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
10072024-12-20T22:31:01.075ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
10082024-12-20T22:31:01.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10092024-12-20T22:31:01.077ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "0cd3a1e7-2c3c-42ed-9aea-a87060491a80", "date": "Fri, 20 Dec 2024 22:31:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
10102024-12-20T22:31:01.077ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
10112024-12-20T22:31:01.077ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10122024-12-20T22:31:01.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10132024-12-20T22:31:01.078ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a35b2b9d-986c-4314-8aec-99825e9f802b", "date": "Fri, 20 Dec 2024 22:31:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
10142024-12-20T22:31:01.079ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
10152024-12-20T22:31:01.080ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10162024-12-20T22:31:01.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10172024-12-20T22:31:01.080ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
10182024-12-20T22:31:01.080ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
10192024-12-20T22:31:01.080ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bdf1beae-8e43-4d48-bbd4-a7392155f632", "date": "Fri, 20 Dec 2024 22:31:00 GMT"} })
10202024-12-20T22:31:01.080ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10212024-12-20T22:31:01.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10222024-12-20T22:31:01.081ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
10232024-12-20T22:31:01.081ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 510.014305ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
10242024-12-20T22:31:01.081ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10252024-12-20T22:31:01.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10262024-12-20T22:31:01.082ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10272024-12-20T22:31:01.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10282024-12-20T22:31:01.132ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10292024-12-20T22:31:01.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10302024-12-20T22:31:01.135ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
10312024-12-20T22:31:01.135ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8c28f44-db36-40db-a41b-94d5bbdf831d", "content-length": "691", "date": "Fri, 20 Dec 2024 22:31:00 GMT"} })
10322024-12-20T22:31:01.135ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
10332024-12-20T22:31:01.135ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
10342024-12-20T22:31:01.135ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
10352024-12-20T22:31:01.136ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 563.346626ms iteration = 11 status = {}
10362024-12-20T22:31:01.136ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10372024-12-20T22:31:01.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10382024-12-20T22:31:01.137ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9fedf0d4-8a86-4506-bf93-224faabd5e37, rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b26f0563-25fb-4d7c-8480-dd368ac01105) } rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
10392024-12-20T22:31:01.137ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10402024-12-20T22:31:01.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10412024-12-20T22:31:01.138ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10422024-12-20T22:31:01.138ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10432024-12-20T22:31:01.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10442024-12-20T22:31:01.141ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
10452024-12-20T22:31:01.141ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10462024-12-20T22:31:01.141ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "862065da-12d0-4c77-a530-16ad22e3f317", "date": "Fri, 20 Dec 2024 22:31:00 GMT"} })
10472024-12-20T22:31:01.142ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
10482024-12-20T22:31:01.142ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10492024-12-20T22:31:01.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10502024-12-20T22:31:01.143ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 569.888207ms iteration = 11 status = {}
10512024-12-20T22:31:01.143ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10522024-12-20T22:31:01.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10532024-12-20T22:31:01.145ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10542024-12-20T22:31:01.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10552024-12-20T22:31:01.146ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10562024-12-20T22:31:01.150ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
10572024-12-20T22:31:01.151ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a510076-eeea-4a14-aa19-42a15d1f3439", "content-length": "134", "date": "Fri, 20 Dec 2024 22:31:00 GMT"} })
10582024-12-20T22:31:01.151ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
10592024-12-20T22:31:01.151ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b26f0563-25fb-4d7c-8480-dd368ac01105
10602024-12-20T22:31:01.151ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
10612024-12-20T22:31:01.151ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
10622024-12-20T22:31:01.151ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10632024-12-20T22:31:01.151ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10642024-12-20T22:31:01.151ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10652024-12-20T22:31:01.151ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
10662024-12-20T22:31:01.151ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10672024-12-20T22:31:01.151ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
10682024-12-20T22:31:01.151ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
10692024-12-20T22:31:01.151ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10702024-12-20T22:31:01.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10712024-12-20T22:31:01.153ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
10722024-12-20T22:31:01.153ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10732024-12-20T22:31:01.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10742024-12-20T22:31:01.154ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
10752024-12-20T22:31:01.154ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "894ee66a-25e6-4874-b369-aa87aedbd52c", "content-length": "2", "date": "Fri, 20 Dec 2024 22:31:00 GMT"} })
10762024-12-20T22:31:01.154ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
10772024-12-20T22:31:01.154ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c97ac6e2-b26e-4153-a70f-004b94835ce9", "content-length": "52", "date": "Fri, 20 Dec 2024 22:31:00 GMT"} })
10782024-12-20T22:31:01.154ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
10792024-12-20T22:31:01.154ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
10802024-12-20T22:31:01.157ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10812024-12-20T22:31:01.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10822024-12-20T22:31:01.159ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10832024-12-20T22:31:01.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10842024-12-20T22:31:01.160ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10852024-12-20T22:31:01.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10862024-12-20T22:31:01.163ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10872024-12-20T22:31:01.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10882024-12-20T22:31:01.164ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10892024-12-20T22:31:01.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10902024-12-20T22:31:01.165ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10912024-12-20T22:31:01.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10922024-12-20T22:31:01.167ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10932024-12-20T22:31:01.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10942024-12-20T22:31:01.169ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10952024-12-20T22:31:01.172ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
10962024-12-20T22:31:01.172ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10972024-12-20T22:31:01.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10982024-12-20T22:31:01.173ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10992024-12-20T22:31:01.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11002024-12-20T22:31:01.175ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11012024-12-20T22:31:01.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11022024-12-20T22:31:01.176ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11032024-12-20T22:31:01.179ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
11042024-12-20T22:31:01.179ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11052024-12-20T22:31:01.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11062024-12-20T22:31:01.189ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 7db65b4a-d789-43c3-984f-c485a4e2a375, kind: Service { id: c08fb79e-9df2-49bb-be41-3925df103e75 }, name: Name("nexus-c08fb79e-9df2-49bb-be41-3925df103e75"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b363f91f-4d69-4910-94ae-1db154f74729, kind: Service { id: 6f9920e4-f78b-446d-a886-f757caf64a7f }, name: Name("nexus-6f9920e4-f78b-446d-a886-f757caf64a7f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 70])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d90729b8-5bad-445f-b9c0-90b3d17d83cf, kind: Service { id: d53e973e-73fc-4117-a9f7-47305be7e74c }, name: Name("nexus-d53e973e-73fc-4117-a9f7-47305be7e74c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 753bd9a0-35c0-4591-b136-cfc90d2d7d2f, kind: Service { id: c65750e1-e505-4d05-b242-145c69974016 }, name: Name("external-dns-c65750e1-e505-4d05-b242-145c69974016"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c5f51553-50ea-408f-ac16-b1e53e3102de, kind: Service { id: 9bcf7579-f08c-458a-b8fa-486beafab77e }, name: Name("external-dns-9bcf7579-f08c-458a-b8fa-486beafab77e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 93])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
11072024-12-20T22:31:01.189ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11082024-12-20T22:31:01.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11092024-12-20T22:31:01.190ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11102024-12-20T22:31:01.192ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
11112024-12-20T22:31:01.192ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11122024-12-20T22:31:01.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11132024-12-20T22:31:01.193ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
11142024-12-20T22:31:01.193ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 753bd9a0-35c0-4591-b136-cfc90d2d7d2f, kind: Service { id: c65750e1-e505-4d05-b242-145c69974016 }, name: Name("external-dns-c65750e1-e505-4d05-b242-145c69974016"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c5f51553-50ea-408f-ac16-b1e53e3102de, kind: Service { id: 9bcf7579-f08c-458a-b8fa-486beafab77e }, name: Name("external-dns-9bcf7579-f08c-458a-b8fa-486beafab77e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 93])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 7db65b4a-d789-43c3-984f-c485a4e2a375, kind: Service { id: c08fb79e-9df2-49bb-be41-3925df103e75 }, name: Name("nexus-c08fb79e-9df2-49bb-be41-3925df103e75"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b363f91f-4d69-4910-94ae-1db154f74729, kind: Service { id: 6f9920e4-f78b-446d-a886-f757caf64a7f }, name: Name("nexus-6f9920e4-f78b-446d-a886-f757caf64a7f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 70])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d90729b8-5bad-445f-b9c0-90b3d17d83cf, kind: Service { id: d53e973e-73fc-4117-a9f7-47305be7e74c }, name: Name("nexus-d53e973e-73fc-4117-a9f7-47305be7e74c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
11152024-12-20T22:31:01.193ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
11162024-12-20T22:31:01.253ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7c32af9b-76a8-4ac8-8198-07ec3b13031f", "date": "Fri, 20 Dec 2024 22:31:00 GMT"} })
11172024-12-20T22:31:01.253ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch = Switch0
11182024-12-20T22:31:01.253ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
11192024-12-20T22:31:01.256ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "380c06ac-c26b-40bf-b908-3a4d46968270", "content-length": "682", "date": "Fri, 20 Dec 2024 22:31:00 GMT"} })
11202024-12-20T22:31:01.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11212024-12-20T22:31:01.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11222024-12-20T22:31:01.259ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11232024-12-20T22:31:01.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11242024-12-20T22:31:01.263ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11252024-12-20T22:31:01.263ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, time_created: 2024-12-20T22:26:35.129481Z, time_modified: 2024-12-20T22:26:35.129481Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
11262024-12-20T22:31:01.263ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
11272024-12-20T22:31:01.263ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11282024-12-20T22:31:01.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11292024-12-20T22:31:01.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11302024-12-20T22:31:01.265ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11312024-12-20T22:31:01.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11322024-12-20T22:31:01.266ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11332024-12-20T22:31:01.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11342024-12-20T22:31:01.267ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11352024-12-20T22:31:01.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
11362024-12-20T22:31:01.272ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 699.053001ms iteration = 11 status = {}
11372024-12-20T22:31:01.300ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
11382024-12-20T22:31:01.301ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "bf48624c-3d5e-4772-8244-ded817d0d4e1", "date": "Fri, 20 Dec 2024 22:31:01 GMT"} })
11392024-12-20T22:31:01.302ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
11402024-12-20T22:31:01.302ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 728.829543ms
11412024-12-20T22:31:01.302ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 728.836633ms iteration = 2 status = {}
11422024-12-20T22:31:01.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c76fae4c-38b4-4b7d-ada8-e161b3e36230 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11432024-12-20T22:31:01.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c76fae4c-38b4-4b7d-ada8-e161b3e36230 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11442024-12-20T22:31:01.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c76fae4c-38b4-4b7d-ada8-e161b3e36230 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11452024-12-20T22:31:02.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b6787a0d-199e-43b5-873f-0897a3349e0a roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11462024-12-20T22:31:02.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b6787a0d-199e-43b5-873f-0897a3349e0a resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11472024-12-20T22:31:02.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1584 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b6787a0d-199e-43b5-873f-0897a3349e0a response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11482024-12-20T22:31:03.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = face6cd8-f004-47b8-bc39-4747ae6c541e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11492024-12-20T22:31:03.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = face6cd8-f004-47b8-bc39-4747ae6c541e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11502024-12-20T22:31:03.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = face6cd8-f004-47b8-bc39-4747ae6c541e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11512024-12-20T22:31:04.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 493d0220-96cc-4f13-98c0-26164fa9767d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11522024-12-20T22:31:04.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 493d0220-96cc-4f13-98c0-26164fa9767d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11532024-12-20T22:31:04.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 493d0220-96cc-4f13-98c0-26164fa9767d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11542024-12-20T22:31:05.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 7eeae85a-b830-46f4-b292-e46fb6e33a6f roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
11552024-12-20T22:31:05.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 7eeae85a-b830-46f4-b292-e46fb6e33a6f resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
11562024-12-20T22:31:05.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 7eeae85a-b830-46f4-b292-e46fb6e33a6f response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
11572024-12-20T22:31:05.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 3bf29c19-7ed9-4b14-9837-ec09cb67dd22 roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
11582024-12-20T22:31:05.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 3bf29c19-7ed9-4b14-9837-ec09cb67dd22 resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
11592024-12-20T22:31:05.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 3bf29c19-7ed9-4b14-9837-ec09cb67dd22 response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
11602024-12-20T22:31:05.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 497 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 687d8daa-7692-42f9-a609-dc71bf60d330 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
11612024-12-20T22:31:05.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ea75f1bf-284a-4690-9c59-b1c44c99cbf3 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11622024-12-20T22:31:05.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ea75f1bf-284a-4690-9c59-b1c44c99cbf3 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11632024-12-20T22:31:05.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1999 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ea75f1bf-284a-4690-9c59-b1c44c99cbf3 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11642024-12-20T22:31:06.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9267eec4-707b-41dd-aeae-1a2a6104d5ff roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11652024-12-20T22:31:06.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9267eec4-707b-41dd-aeae-1a2a6104d5ff resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11662024-12-20T22:31:06.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9267eec4-707b-41dd-aeae-1a2a6104d5ff response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11672024-12-20T22:31:07.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ffe1cf10-9660-4310-b680-a46973f0d694 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11682024-12-20T22:31:07.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ffe1cf10-9660-4310-b680-a46973f0d694 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11692024-12-20T22:31:07.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ffe1cf10-9660-4310-b680-a46973f0d694 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11702024-12-20T22:31:08.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 710946eb-01d1-47d6-969e-ae30df31a2f9 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11712024-12-20T22:31:08.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 710946eb-01d1-47d6-969e-ae30df31a2f9 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11722024-12-20T22:31:08.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 710946eb-01d1-47d6-969e-ae30df31a2f9 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11732024-12-20T22:31:09.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 36dad676-8e9a-4380-9b31-c184710360b1 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11742024-12-20T22:31:09.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 36dad676-8e9a-4380-9b31-c184710360b1 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11752024-12-20T22:31:09.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2472 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 36dad676-8e9a-4380-9b31-c184710360b1 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11762024-12-20T22:31:10.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
11772024-12-20T22:31:10.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11782024-12-20T22:31:10.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11792024-12-20T22:31:10.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
11802024-12-20T22:31:10.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11812024-12-20T22:31:10.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11822024-12-20T22:31:10.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11832024-12-20T22:31:10.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11842024-12-20T22:31:10.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11852024-12-20T22:31:10.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11862024-12-20T22:31:10.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11872024-12-20T22:31:10.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11882024-12-20T22:31:10.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11892024-12-20T22:31:10.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
11902024-12-20T22:31:10.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11912024-12-20T22:31:10.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11922024-12-20T22:31:10.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
11932024-12-20T22:31:10.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.032483ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
11942024-12-20T22:31:10.614ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11952024-12-20T22:31:10.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11962024-12-20T22:31:10.616ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.088039ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11972024-12-20T22:31:10.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 28a6709a-1b4b-41d4-a1b2-d61b4f110a48 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11982024-12-20T22:31:10.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 28a6709a-1b4b-41d4-a1b2-d61b4f110a48 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
11992024-12-20T22:31:10.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2088 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 28a6709a-1b4b-41d4-a1b2-d61b4f110a48 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12002024-12-20T22:31:11.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f803ebaa-9883-4157-9a51-a857d3cec34b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12012024-12-20T22:31:11.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f803ebaa-9883-4157-9a51-a857d3cec34b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12022024-12-20T22:31:11.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1710 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f803ebaa-9883-4157-9a51-a857d3cec34b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12032024-12-20T22:31:12.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d302cce9-71b0-427a-8657-76d412c65824 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12042024-12-20T22:31:12.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d302cce9-71b0-427a-8657-76d412c65824 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12052024-12-20T22:31:12.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1913 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d302cce9-71b0-427a-8657-76d412c65824 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12062024-12-20T22:31:13.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2f6ee569-fdc1-4752-9242-27606a63e33e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12072024-12-20T22:31:13.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2f6ee569-fdc1-4752-9242-27606a63e33e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12082024-12-20T22:31:13.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2f6ee569-fdc1-4752-9242-27606a63e33e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12092024-12-20T22:31:14.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 16b2d48a-85bb-410e-94aa-0b10f72851f9 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12102024-12-20T22:31:14.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 16b2d48a-85bb-410e-94aa-0b10f72851f9 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12112024-12-20T22:31:14.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 16b2d48a-85bb-410e-94aa-0b10f72851f9 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12122024-12-20T22:31:15.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 636 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = c4538df4-5f96-4601-9976-6e5b2ead410b response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
12132024-12-20T22:31:15.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1c5b9238-9e8c-4233-b499-29bbf4e5cd4a roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12142024-12-20T22:31:15.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1c5b9238-9e8c-4233-b499-29bbf4e5cd4a resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12152024-12-20T22:31:15.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1764 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1c5b9238-9e8c-4233-b499-29bbf4e5cd4a response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12162024-12-20T22:31:16.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d71ee98a-2edc-4dab-9584-7467f453cf28 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12172024-12-20T22:31:16.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d71ee98a-2edc-4dab-9584-7467f453cf28 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12182024-12-20T22:31:16.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d71ee98a-2edc-4dab-9584-7467f453cf28 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12192024-12-20T22:31:17.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0341651a-bf82-4dfd-8d86-bfc323911201 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12202024-12-20T22:31:17.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0341651a-bf82-4dfd-8d86-bfc323911201 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12212024-12-20T22:31:17.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1966 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0341651a-bf82-4dfd-8d86-bfc323911201 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12222024-12-20T22:31:19.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5b183b36-fe00-43cd-b5df-04629ce71b89 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12232024-12-20T22:31:19.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5b183b36-fe00-43cd-b5df-04629ce71b89 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12242024-12-20T22:31:19.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5b183b36-fe00-43cd-b5df-04629ce71b89 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12252024-12-20T22:31:20.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = babc34af-3210-4d33-8e34-1dacb2b79aeb roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12262024-12-20T22:31:20.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = babc34af-3210-4d33-8e34-1dacb2b79aeb resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12272024-12-20T22:31:20.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = babc34af-3210-4d33-8e34-1dacb2b79aeb response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12282024-12-20T22:31:20.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = e82a3d4f-8cd5-4adc-99f8-40dec9c08f5f roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
12292024-12-20T22:31:20.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = e82a3d4f-8cd5-4adc-99f8-40dec9c08f5f resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
12302024-12-20T22:31:20.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = e82a3d4f-8cd5-4adc-99f8-40dec9c08f5f response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
12312024-12-20T22:31:20.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 0c919c16-4d6e-4dca-8bc8-c06f238ccbc6 roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
12322024-12-20T22:31:20.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 0c919c16-4d6e-4dca-8bc8-c06f238ccbc6 resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
12332024-12-20T22:31:20.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2531 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 0c919c16-4d6e-4dca-8bc8-c06f238ccbc6 response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
12342024-12-20T22:31:20.571ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
12352024-12-20T22:31:20.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12362024-12-20T22:31:20.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12372024-12-20T22:31:20.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
12382024-12-20T22:31:20.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12392024-12-20T22:31:20.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12402024-12-20T22:31:20.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12412024-12-20T22:31:20.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12422024-12-20T22:31:20.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12432024-12-20T22:31:20.576ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.609829ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12442024-12-20T22:31:20.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12452024-12-20T22:31:20.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12462024-12-20T22:31:20.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12472024-12-20T22:31:20.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12482024-12-20T22:31:20.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12492024-12-20T22:31:20.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12502024-12-20T22:31:20.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
12512024-12-20T22:31:20.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12522024-12-20T22:31:20.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12532024-12-20T22:31:20.594ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
12542024-12-20T22:31:20.594ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.751777ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
12552024-12-20T22:31:21.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 676aa20e-d53c-44a5-90db-3571574b0874 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12562024-12-20T22:31:21.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 676aa20e-d53c-44a5-90db-3571574b0874 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12572024-12-20T22:31:21.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 676aa20e-d53c-44a5-90db-3571574b0874 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12582024-12-20T22:31:22.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8d137c50-7e01-463a-8dfc-dada94defb91 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12592024-12-20T22:31:22.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8d137c50-7e01-463a-8dfc-dada94defb91 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12602024-12-20T22:31:22.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2689 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8d137c50-7e01-463a-8dfc-dada94defb91 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12612024-12-20T22:31:23.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 93407155-2af3-40b6-9d34-2b40ddbfd182 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12622024-12-20T22:31:23.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 93407155-2af3-40b6-9d34-2b40ddbfd182 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12632024-12-20T22:31:23.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 93407155-2af3-40b6-9d34-2b40ddbfd182 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12642024-12-20T22:31:24.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = dda71394-54ce-45c0-82ad-5326f09a6303 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12652024-12-20T22:31:24.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = dda71394-54ce-45c0-82ad-5326f09a6303 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12662024-12-20T22:31:24.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = dda71394-54ce-45c0-82ad-5326f09a6303 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12672024-12-20T22:31:25.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 52a3ec53-6c3d-41b5-b020-40e54e921ae5 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12682024-12-20T22:31:25.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 52a3ec53-6c3d-41b5-b020-40e54e921ae5 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12692024-12-20T22:31:25.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 52a3ec53-6c3d-41b5-b020-40e54e921ae5 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12702024-12-20T22:31:25.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 624 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = bf4ad511-0025-4ea0-a787-0ee0554aaef4 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
12712024-12-20T22:31:26.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 48a10c38-e434-47c7-847a-56603130a04b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12722024-12-20T22:31:26.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 48a10c38-e434-47c7-847a-56603130a04b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12732024-12-20T22:31:26.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 48a10c38-e434-47c7-847a-56603130a04b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12742024-12-20T22:31:27.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 175a0cc2-19d1-4142-9c40-b77ddbcc2258 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12752024-12-20T22:31:27.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 175a0cc2-19d1-4142-9c40-b77ddbcc2258 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12762024-12-20T22:31:27.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 175a0cc2-19d1-4142-9c40-b77ddbcc2258 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12772024-12-20T22:31:28.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 79c6d17f-3e84-4af5-8f56-aa371ec9e21a roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12782024-12-20T22:31:28.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 79c6d17f-3e84-4af5-8f56-aa371ec9e21a resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12792024-12-20T22:31:28.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 79c6d17f-3e84-4af5-8f56-aa371ec9e21a response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12802024-12-20T22:31:29.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 24fc1e34-b1ac-4701-b956-8959388e97a3 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12812024-12-20T22:31:29.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 24fc1e34-b1ac-4701-b956-8959388e97a3 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12822024-12-20T22:31:29.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1838 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 24fc1e34-b1ac-4701-b956-8959388e97a3 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12832024-12-20T22:31:30.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 36a8b592-3500-4ad2-b4f0-5356fa4e892e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12842024-12-20T22:31:30.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 36a8b592-3500-4ad2-b4f0-5356fa4e892e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12852024-12-20T22:31:30.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2791 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 36a8b592-3500-4ad2-b4f0-5356fa4e892e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
12862024-12-20T22:31:30.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = f6678fee-6131-4464-9866-d77945133c03 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
12872024-12-20T22:31:30.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = f6678fee-6131-4464-9866-d77945133c03 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
12882024-12-20T22:31:30.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3763 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = f6678fee-6131-4464-9866-d77945133c03 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
12892024-12-20T22:31:30.570ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
12902024-12-20T22:31:30.571ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
12912024-12-20T22:31:30.571ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
12922024-12-20T22:31:30.571ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
12932024-12-20T22:31:30.571ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12942024-12-20T22:31:30.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
12952024-12-20T22:31:30.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12962024-12-20T22:31:30.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
12972024-12-20T22:31:30.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12982024-12-20T22:31:30.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12992024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
13002024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13012024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
13022024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
13032024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13042024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
13052024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
13062024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
13072024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13082024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13092024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
13102024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13112024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
13122024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
13132024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13142024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
13152024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
13162024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
13172024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13182024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13192024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13202024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
13212024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
13222024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13232024-12-20T22:31:30.573ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
13242024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
13252024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13262024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13272024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13282024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13292024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
13302024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13312024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13322024-12-20T22:31:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13332024-12-20T22:31:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13342024-12-20T22:31:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13352024-12-20T22:31:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13362024-12-20T22:31:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13372024-12-20T22:31:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13382024-12-20T22:31:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13392024-12-20T22:31:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
13402024-12-20T22:31:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13412024-12-20T22:31:30.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1038, tv_nsec: 186715625 } })
13422024-12-20T22:31:30.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1038, tv_nsec: 186743285 } })
13432024-12-20T22:31:30.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
13442024-12-20T22:31:30.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
13452024-12-20T22:31:30.574ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.854167ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
13462024-12-20T22:31:30.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13472024-12-20T22:31:30.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13482024-12-20T22:31:30.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13492024-12-20T22:31:30.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13502024-12-20T22:31:30.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13512024-12-20T22:31:30.578ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13522024-12-20T22:31:30.579ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13532024-12-20T22:31:30.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13542024-12-20T22:31:30.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
13552024-12-20T22:31:30.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13562024-12-20T22:31:30.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13572024-12-20T22:31:30.582ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13582024-12-20T22:31:30.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13592024-12-20T22:31:30.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13602024-12-20T22:31:30.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
13612024-12-20T22:31:30.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13622024-12-20T22:31:30.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13632024-12-20T22:31:30.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13642024-12-20T22:31:30.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
13652024-12-20T22:31:30.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13662024-12-20T22:31:30.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13672024-12-20T22:31:30.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13682024-12-20T22:31:30.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13692024-12-20T22:31:30.589ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1038, tv_nsec: 202386497 } })
13702024-12-20T22:31:30.590ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
13712024-12-20T22:31:30.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13722024-12-20T22:31:30.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
13732024-12-20T22:31:30.595ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13742024-12-20T22:31:30.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13752024-12-20T22:31:30.597ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13762024-12-20T22:31:30.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13772024-12-20T22:31:30.619ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
13782024-12-20T22:31:30.619ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.654636ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
13792024-12-20T22:31:30.634ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13802024-12-20T22:31:30.636ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13812024-12-20T22:31:30.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13822024-12-20T22:31:30.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13832024-12-20T22:31:30.637ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13842024-12-20T22:31:30.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13852024-12-20T22:31:30.637ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13862024-12-20T22:31:30.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13872024-12-20T22:31:30.638ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13882024-12-20T22:31:30.638ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13892024-12-20T22:31:30.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13902024-12-20T22:31:30.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13912024-12-20T22:31:30.639ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 65.472456ms iteration = 12 status = {"errors":[],"finish_invoked_ok":[]}
13922024-12-20T22:31:30.639ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13932024-12-20T22:31:30.639ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
13942024-12-20T22:31:30.639ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13952024-12-20T22:31:30.640ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13962024-12-20T22:31:30.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13972024-12-20T22:31:30.640ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 66.590208ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
13982024-12-20T22:31:30.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13992024-12-20T22:31:30.640ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14002024-12-20T22:31:30.642ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14012024-12-20T22:31:30.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
14022024-12-20T22:31:30.644ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14032024-12-20T22:31:30.644ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.761643ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
14042024-12-20T22:31:30.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14052024-12-20T22:31:30.644ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14062024-12-20T22:31:30.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14072024-12-20T22:31:30.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14082024-12-20T22:31:30.645ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14092024-12-20T22:31:30.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14102024-12-20T22:31:30.646ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14112024-12-20T22:31:30.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14122024-12-20T22:31:30.646ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 72.678076ms iteration = 12 status = 0
14132024-12-20T22:31:30.649ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.937305ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14142024-12-20T22:31:30.652ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14152024-12-20T22:31:30.654ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
14162024-12-20T22:31:30.654ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14172024-12-20T22:31:30.654ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14182024-12-20T22:31:30.654ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14192024-12-20T22:31:30.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14202024-12-20T22:31:30.655ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "724ad06a-351b-49e5-952e-ecd93343ef84", "content-length": "26", "date": "Fri, 20 Dec 2024 22:31:30 GMT"} })
14212024-12-20T22:31:30.655ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14222024-12-20T22:31:30.657ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14232024-12-20T22:31:30.659ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
14242024-12-20T22:31:30.659ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 85.85037ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
14252024-12-20T22:31:30.679ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 zone_address = fd00:1122:3344:101::2
14262024-12-20T22:31:30.679ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14272024-12-20T22:31:30.679ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bca4a332-6917-4029-bd55-77fe77188e74", "content-length": "26", "date": "Fri, 20 Dec 2024 22:31:30 GMT"} })
14282024-12-20T22:31:30.679ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14292024-12-20T22:31:30.680ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 106.836899ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14302024-12-20T22:31:30.680ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
14312024-12-20T22:31:30.692ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14322024-12-20T22:31:30.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14332024-12-20T22:31:30.700ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
14342024-12-20T22:31:30.700ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14352024-12-20T22:31:30.700ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "910abbb7-cf9e-447a-b945-f271ee8c5457", "content-length": "26", "date": "Fri, 20 Dec 2024 22:31:30 GMT"} })
14362024-12-20T22:31:30.700ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14372024-12-20T22:31:30.701ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14382024-12-20T22:31:30.701ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
14392024-12-20T22:31:30.701ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14402024-12-20T22:31:30.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14412024-12-20T22:31:30.703ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14422024-12-20T22:31:30.744ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14432024-12-20T22:31:30.744ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
14442024-12-20T22:31:30.744ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 170.546797ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
14452024-12-20T22:31:30.744ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 171.246896ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
14462024-12-20T22:31:30.750ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14472024-12-20T22:31:30.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14482024-12-20T22:31:30.752ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14492024-12-20T22:31:30.754ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14502024-12-20T22:31:30.754ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14512024-12-20T22:31:30.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14522024-12-20T22:31:30.756ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14532024-12-20T22:31:30.758ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14542024-12-20T22:31:30.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14552024-12-20T22:31:30.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14562024-12-20T22:31:30.778ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 205.08662ms iteration = 14 status = {"physical_disks_added":0}
14572024-12-20T22:31:30.798ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
14582024-12-20T22:31:30.799ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14592024-12-20T22:31:30.799ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "92f0b99a-e736-45c8-bdb7-08bb36c98994", "content-length": "372", "date": "Fri, 20 Dec 2024 22:31:30 GMT"} })
14602024-12-20T22:31:30.799ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14612024-12-20T22:31:30.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14622024-12-20T22:31:30.812ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
14632024-12-20T22:31:30.812ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
14642024-12-20T22:31:30.812ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5962991b-a6fa-47ef-a3ab-f55fb4a97d30", "date": "Fri, 20 Dec 2024 22:31:30 GMT"} })
14652024-12-20T22:31:30.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14662024-12-20T22:31:30.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14672024-12-20T22:31:30.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14682024-12-20T22:31:30.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14692024-12-20T22:31:30.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14702024-12-20T22:31:30.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14712024-12-20T22:31:30.821ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
14722024-12-20T22:31:30.821ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14732024-12-20T22:31:30.821ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4495479d-5260-4062-a575-82b4a93eb8b8", "date": "Fri, 20 Dec 2024 22:31:30 GMT"} })
14742024-12-20T22:31:30.822ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 249.279549ms iteration = 12 status = {}
14752024-12-20T22:31:30.843ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 272.185251ms iteration = 12 status = {}
14762024-12-20T22:31:30.861ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
14772024-12-20T22:31:30.861ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4efdf5e7-a24c-48a5-ab1e-a27e9076b4a9", "content-length": "1", "date": "Fri, 20 Dec 2024 22:31:30 GMT"} })
14782024-12-20T22:31:30.863ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14792024-12-20T22:31:30.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14802024-12-20T22:31:30.865ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 294.548459ms iteration = 12 status = null
14812024-12-20T22:31:30.907ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14822024-12-20T22:31:30.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14832024-12-20T22:31:30.908ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9fedf0d4-8a86-4506-bf93-224faabd5e37, rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b26f0563-25fb-4d7c-8480-dd368ac01105) } rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
14842024-12-20T22:31:30.908ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14852024-12-20T22:31:30.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14862024-12-20T22:31:30.918ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
14872024-12-20T22:31:30.918ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "432e58f1-877b-43d8-a4e6-0db4a2a19e3e", "content-length": "691", "date": "Fri, 20 Dec 2024 22:31:30 GMT"} })
14882024-12-20T22:31:30.918ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
14892024-12-20T22:31:30.918ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
14902024-12-20T22:31:30.918ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
14912024-12-20T22:31:30.919ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 345.814824ms iteration = 12 status = {}
14922024-12-20T22:31:30.919ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
14932024-12-20T22:31:30.920ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f5ef49d-134c-4f93-91e0-3238d84d6d7d", "content-length": "134", "date": "Fri, 20 Dec 2024 22:31:30 GMT"} })
14942024-12-20T22:31:30.920ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
14952024-12-20T22:31:30.920ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b26f0563-25fb-4d7c-8480-dd368ac01105
14962024-12-20T22:31:30.920ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
14972024-12-20T22:31:30.920ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
14982024-12-20T22:31:30.920ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14992024-12-20T22:31:30.920ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15002024-12-20T22:31:30.920ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15012024-12-20T22:31:30.920ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15022024-12-20T22:31:30.920ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15032024-12-20T22:31:30.920ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15042024-12-20T22:31:30.920ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
15052024-12-20T22:31:30.920ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15062024-12-20T22:31:30.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15072024-12-20T22:31:30.923ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
15082024-12-20T22:31:30.923ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f2ac241-b28a-41d6-a505-7bc67dc9c3d4", "content-length": "2", "date": "Fri, 20 Dec 2024 22:31:30 GMT"} })
15092024-12-20T22:31:30.923ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
15102024-12-20T22:31:30.923ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b17c054f-6ec6-4df7-b983-cd1db7fe2704", "content-length": "52", "date": "Fri, 20 Dec 2024 22:31:30 GMT"} })
15112024-12-20T22:31:30.923ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
15122024-12-20T22:31:30.923ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
15132024-12-20T22:31:31.024ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "420c4450-34d9-443b-bb32-747ac834772a", "date": "Fri, 20 Dec 2024 22:31:30 GMT"} })
15142024-12-20T22:31:31.024ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch = Switch0
15152024-12-20T22:31:31.024ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
15162024-12-20T22:31:31.025ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "113fe030-8e82-4811-847b-b895807d8c17", "content-length": "682", "date": "Fri, 20 Dec 2024 22:31:30 GMT"} })
15172024-12-20T22:31:31.025ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15182024-12-20T22:31:31.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15192024-12-20T22:31:31.029ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15202024-12-20T22:31:31.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15212024-12-20T22:31:31.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15222024-12-20T22:31:31.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15232024-12-20T22:31:31.035ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15242024-12-20T22:31:31.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15252024-12-20T22:31:31.042ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 468.768736ms iteration = 12 status = {}
15262024-12-20T22:31:31.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a5dbe2da-3de2-40aa-a7c6-c687bf9d1b71 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15272024-12-20T22:31:31.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a5dbe2da-3de2-40aa-a7c6-c687bf9d1b71 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15282024-12-20T22:31:31.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a5dbe2da-3de2-40aa-a7c6-c687bf9d1b71 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15292024-12-20T22:31:32.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 295b98b4-61ee-438f-a3d8-f02f22f13635 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15302024-12-20T22:31:32.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 295b98b4-61ee-438f-a3d8-f02f22f13635 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15312024-12-20T22:31:32.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 295b98b4-61ee-438f-a3d8-f02f22f13635 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15322024-12-20T22:31:33.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ee378462-3ca6-48d0-b7cf-05e94ca2079a roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15332024-12-20T22:31:33.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ee378462-3ca6-48d0-b7cf-05e94ca2079a resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15342024-12-20T22:31:33.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ee378462-3ca6-48d0-b7cf-05e94ca2079a response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15352024-12-20T22:31:34.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7cf2248b-de03-4bdd-abc0-422e52fa77e1 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15362024-12-20T22:31:34.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7cf2248b-de03-4bdd-abc0-422e52fa77e1 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15372024-12-20T22:31:34.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7cf2248b-de03-4bdd-abc0-422e52fa77e1 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15382024-12-20T22:31:35.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 53aea564-d0b6-4da2-acbc-f0ddb0f96996 roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
15392024-12-20T22:31:35.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 53aea564-d0b6-4da2-acbc-f0ddb0f96996 resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
15402024-12-20T22:31:35.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 53aea564-d0b6-4da2-acbc-f0ddb0f96996 response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
15412024-12-20T22:31:35.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = a228080a-fda1-4964-9aba-1ff358f9e1e2 roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
15422024-12-20T22:31:35.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = a228080a-fda1-4964-9aba-1ff358f9e1e2 resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
15432024-12-20T22:31:35.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2575 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = a228080a-fda1-4964-9aba-1ff358f9e1e2 response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
15442024-12-20T22:31:35.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 530 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 6e6cd970-cf25-4088-a9d8-292d4f0af6fe response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
15452024-12-20T22:31:35.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e19291ad-5509-48bb-acd1-f08705dd4972 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15462024-12-20T22:31:35.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e19291ad-5509-48bb-acd1-f08705dd4972 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15472024-12-20T22:31:35.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1709 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e19291ad-5509-48bb-acd1-f08705dd4972 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15482024-12-20T22:31:36.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b57c11e1-ae32-447c-ad71-5e7caf8ae9d0 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15492024-12-20T22:31:36.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b57c11e1-ae32-447c-ad71-5e7caf8ae9d0 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15502024-12-20T22:31:36.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2456 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b57c11e1-ae32-447c-ad71-5e7caf8ae9d0 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15512024-12-20T22:31:37.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6f6646da-0857-4579-bb02-ecaa75e9c4dd roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15522024-12-20T22:31:37.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6f6646da-0857-4579-bb02-ecaa75e9c4dd resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15532024-12-20T22:31:37.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6f6646da-0857-4579-bb02-ecaa75e9c4dd response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15542024-12-20T22:31:38.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b2d9e5f9-15a9-452e-91bf-b5fa090fab8f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15552024-12-20T22:31:38.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b2d9e5f9-15a9-452e-91bf-b5fa090fab8f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15562024-12-20T22:31:38.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b2d9e5f9-15a9-452e-91bf-b5fa090fab8f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15572024-12-20T22:31:39.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f6393e3f-627b-4e2a-9ba2-a82ace2048c7 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15582024-12-20T22:31:39.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f6393e3f-627b-4e2a-9ba2-a82ace2048c7 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15592024-12-20T22:31:39.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f6393e3f-627b-4e2a-9ba2-a82ace2048c7 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15602024-12-20T22:31:40.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f9f11b3a-545a-448d-8b54-ad2a93fa4874 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15612024-12-20T22:31:40.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f9f11b3a-545a-448d-8b54-ad2a93fa4874 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15622024-12-20T22:31:40.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f9f11b3a-545a-448d-8b54-ad2a93fa4874 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15632024-12-20T22:31:40.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
15642024-12-20T22:31:40.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15652024-12-20T22:31:40.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15662024-12-20T22:31:40.572ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
15672024-12-20T22:31:40.572ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15682024-12-20T22:31:40.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15692024-12-20T22:31:40.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15702024-12-20T22:31:40.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15712024-12-20T22:31:40.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15722024-12-20T22:31:40.576ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.151364ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15732024-12-20T22:31:40.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15742024-12-20T22:31:40.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15752024-12-20T22:31:40.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15762024-12-20T22:31:40.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15772024-12-20T22:31:40.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15782024-12-20T22:31:40.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15792024-12-20T22:31:40.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
15802024-12-20T22:31:40.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15812024-12-20T22:31:40.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15822024-12-20T22:31:40.592ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
15832024-12-20T22:31:40.592ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.093325ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
15842024-12-20T22:31:41.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8e499bb9-4c07-4fce-94c1-bed28bb03a3e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15852024-12-20T22:31:41.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8e499bb9-4c07-4fce-94c1-bed28bb03a3e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15862024-12-20T22:31:41.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8e499bb9-4c07-4fce-94c1-bed28bb03a3e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15872024-12-20T22:31:42.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 09546b24-bd94-4ee1-9c24-9dec3a8090e7 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15882024-12-20T22:31:42.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 09546b24-bd94-4ee1-9c24-9dec3a8090e7 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15892024-12-20T22:31:42.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 09546b24-bd94-4ee1-9c24-9dec3a8090e7 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15902024-12-20T22:31:43.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 32c3f1d7-5533-4445-b934-f224a620e00e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15912024-12-20T22:31:43.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 32c3f1d7-5533-4445-b934-f224a620e00e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15922024-12-20T22:31:43.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 32c3f1d7-5533-4445-b934-f224a620e00e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15932024-12-20T22:31:44.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a562a68b-31fd-4fcd-b38f-56c45d53e6ea roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15942024-12-20T22:31:44.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a562a68b-31fd-4fcd-b38f-56c45d53e6ea resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15952024-12-20T22:31:44.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a562a68b-31fd-4fcd-b38f-56c45d53e6ea response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15962024-12-20T22:31:45.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 587 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 73a3be8b-5036-4b20-a095-b5d9e8b97e35 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
15972024-12-20T22:31:45.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e66a74e4-3822-4cc0-9189-6f6445c15e97 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15982024-12-20T22:31:45.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e66a74e4-3822-4cc0-9189-6f6445c15e97 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
15992024-12-20T22:31:45.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1930 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e66a74e4-3822-4cc0-9189-6f6445c15e97 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16002024-12-20T22:31:46.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7d0c38b4-322d-48b8-84dc-41736eb13c36 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16012024-12-20T22:31:46.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7d0c38b4-322d-48b8-84dc-41736eb13c36 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16022024-12-20T22:31:46.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4658 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7d0c38b4-322d-48b8-84dc-41736eb13c36 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16032024-12-20T22:31:47.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 93102732-d5bd-424f-a5bd-858947e51fba roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16042024-12-20T22:31:47.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 93102732-d5bd-424f-a5bd-858947e51fba resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16052024-12-20T22:31:47.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2518 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 93102732-d5bd-424f-a5bd-858947e51fba response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16062024-12-20T22:31:48.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 30a0e547-304f-49ad-84cf-6e339e097223 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16072024-12-20T22:31:48.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 30a0e547-304f-49ad-84cf-6e339e097223 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16082024-12-20T22:31:48.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 30a0e547-304f-49ad-84cf-6e339e097223 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16092024-12-20T22:31:49.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5b1b8a10-1d04-4d91-962d-dc5da6e9ad5f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16102024-12-20T22:31:49.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5b1b8a10-1d04-4d91-962d-dc5da6e9ad5f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16112024-12-20T22:31:49.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1645 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5b1b8a10-1d04-4d91-962d-dc5da6e9ad5f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16122024-12-20T22:31:50.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = f74dd97a-2217-40b9-8ec2-263130fa6f97 roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
16132024-12-20T22:31:50.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = f74dd97a-2217-40b9-8ec2-263130fa6f97 resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
16142024-12-20T22:31:50.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2622 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = f74dd97a-2217-40b9-8ec2-263130fa6f97 response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
16152024-12-20T22:31:50.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 33d7f2e2-eea2-4311-8f0b-9352f52f751e roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
16162024-12-20T22:31:50.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 33d7f2e2-eea2-4311-8f0b-9352f52f751e resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
16172024-12-20T22:31:50.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2627 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 33d7f2e2-eea2-4311-8f0b-9352f52f751e response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
16182024-12-20T22:31:50.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
16192024-12-20T22:31:50.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16202024-12-20T22:31:50.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16212024-12-20T22:31:50.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
16222024-12-20T22:31:50.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16232024-12-20T22:31:50.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16242024-12-20T22:31:50.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16252024-12-20T22:31:50.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16262024-12-20T22:31:50.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16272024-12-20T22:31:50.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.141094ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16282024-12-20T22:31:50.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16292024-12-20T22:31:50.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16302024-12-20T22:31:50.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16312024-12-20T22:31:50.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16322024-12-20T22:31:50.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16332024-12-20T22:31:50.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16342024-12-20T22:31:50.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
16352024-12-20T22:31:50.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16362024-12-20T22:31:50.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16372024-12-20T22:31:50.592ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
16382024-12-20T22:31:50.592ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.215798ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
16392024-12-20T22:31:50.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 66297465-ae48-41d8-bf9c-970b6f9acf53 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16402024-12-20T22:31:50.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 66297465-ae48-41d8-bf9c-970b6f9acf53 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16412024-12-20T22:31:50.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 66297465-ae48-41d8-bf9c-970b6f9acf53 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16422024-12-20T22:31:51.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4e7fadd9-7be0-465f-aca9-107c3ef3af81 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16432024-12-20T22:31:51.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4e7fadd9-7be0-465f-aca9-107c3ef3af81 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16442024-12-20T22:31:51.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1581 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4e7fadd9-7be0-465f-aca9-107c3ef3af81 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16452024-12-20T22:31:52.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7d8b65e2-0778-4c85-84e4-82e127611099 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16462024-12-20T22:31:52.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7d8b65e2-0778-4c85-84e4-82e127611099 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16472024-12-20T22:31:52.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7d8b65e2-0778-4c85-84e4-82e127611099 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16482024-12-20T22:31:53.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a65d8f79-aa0d-4d55-be81-6ede6819d2d7 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16492024-12-20T22:31:53.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a65d8f79-aa0d-4d55-be81-6ede6819d2d7 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16502024-12-20T22:31:53.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a65d8f79-aa0d-4d55-be81-6ede6819d2d7 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16512024-12-20T22:31:54.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a00268ea-6e8c-46c9-aed5-63667cda4d20 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16522024-12-20T22:31:54.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a00268ea-6e8c-46c9-aed5-63667cda4d20 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16532024-12-20T22:31:54.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a00268ea-6e8c-46c9-aed5-63667cda4d20 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16542024-12-20T22:31:55.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 788 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 0fc633ac-66b5-4f47-8a48-c88037b15e03 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
16552024-12-20T22:31:55.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 16c62272-479b-4a3e-bc9f-ee31f8f69b3e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16562024-12-20T22:31:55.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 16c62272-479b-4a3e-bc9f-ee31f8f69b3e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16572024-12-20T22:31:55.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 16c62272-479b-4a3e-bc9f-ee31f8f69b3e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16582024-12-20T22:31:56.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6d92cfbd-cd28-43b1-9b49-e00c3d1aba44 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16592024-12-20T22:31:56.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6d92cfbd-cd28-43b1-9b49-e00c3d1aba44 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16602024-12-20T22:31:56.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1784 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6d92cfbd-cd28-43b1-9b49-e00c3d1aba44 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16612024-12-20T22:31:57.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7bb639d5-64de-4598-b6ad-dbe14c9ee792 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16622024-12-20T22:31:57.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7bb639d5-64de-4598-b6ad-dbe14c9ee792 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16632024-12-20T22:31:57.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2586 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7bb639d5-64de-4598-b6ad-dbe14c9ee792 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16642024-12-20T22:31:58.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b466f132-a12f-4b6f-b829-d2ee1c284025 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16652024-12-20T22:31:58.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b466f132-a12f-4b6f-b829-d2ee1c284025 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16662024-12-20T22:31:58.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b466f132-a12f-4b6f-b829-d2ee1c284025 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16672024-12-20T22:31:59.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a6696c65-105c-4138-8338-70ec63133ed0 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16682024-12-20T22:31:59.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a6696c65-105c-4138-8338-70ec63133ed0 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16692024-12-20T22:31:59.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2630 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a6696c65-105c-4138-8338-70ec63133ed0 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
16702024-12-20T22:32:00.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 2863823b-a783-4a21-a691-01273fd8c32d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
16712024-12-20T22:32:00.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 2863823b-a783-4a21-a691-01273fd8c32d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
16722024-12-20T22:32:00.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2874 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 2863823b-a783-4a21-a691-01273fd8c32d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
16732024-12-20T22:32:00.571ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
16742024-12-20T22:32:00.571ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
16752024-12-20T22:32:00.571ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
16762024-12-20T22:32:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
16772024-12-20T22:32:00.571ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16782024-12-20T22:32:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
16792024-12-20T22:32:00.571ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
16802024-12-20T22:32:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
16812024-12-20T22:32:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
16822024-12-20T22:32:00.571ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
16832024-12-20T22:32:00.571ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
16842024-12-20T22:32:00.571ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
16852024-12-20T22:32:00.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16862024-12-20T22:32:00.571ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:22:00.571718716 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
16872024-12-20T22:32:00.571ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
16882024-12-20T22:32:00.571ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16892024-12-20T22:32:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
16902024-12-20T22:32:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
16912024-12-20T22:32:00.571ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
16922024-12-20T22:32:00.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16932024-12-20T22:32:00.571ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
16942024-12-20T22:32:00.571ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
16952024-12-20T22:32:00.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16962024-12-20T22:32:00.571ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e
16972024-12-20T22:32:00.571ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.05\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e"}
16982024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
16992024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17002024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
17012024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17022024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17032024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17042024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17052024-12-20T22:32:00.572ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b172144-6fe3-403a-b88e-6be93db6788c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e1e925bb-4266-49d2-b532-0f79860badbb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9d7e78a-d944-4f23-9be0-86e0f1334a43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9d7e78a-d944-4f23-9be0-86e0f1334a43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1068, tv_nsec: 184770211 } })
17062024-12-20T22:32:00.572ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bcf7579-f08c-458a-b8fa-486beafab77e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c65750e1-e505-4d05-b242-145c69974016.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c65750e1-e505-4d05-b242-145c69974016.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1068, tv_nsec: 184840983 } })
17072024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
17082024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.013778ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
17092024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
17102024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17112024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
17122024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
17132024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
17142024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17152024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
17162024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
17172024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
17182024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
17192024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
17202024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
17212024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
17222024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
17232024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
17242024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17252024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
17262024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
17272024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
17282024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
17292024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
17302024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.241505ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
17312024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
17322024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17332024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
17342024-12-20T22:32:00.572ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
17352024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17362024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
17372024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
17382024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17392024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
17402024-12-20T22:32:00.572ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17412024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
17422024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17432024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
17442024-12-20T22:32:00.573ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
17452024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17462024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
17472024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17482024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
17492024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17502024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17512024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
17522024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
17532024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
17542024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
17552024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
17562024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17572024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17582024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17592024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
17602024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17612024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
17622024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17632024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17642024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
17652024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17662024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17672024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17682024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17692024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
17702024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
17712024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
17722024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
17732024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
17742024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
17752024-12-20T22:32:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
17762024-12-20T22:32:00.575ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1068, tv_nsec: 187979319 } })
17772024-12-20T22:32:00.575ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.793225ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
17782024-12-20T22:32:00.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17792024-12-20T22:32:00.575ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1068, tv_nsec: 188132164 } })
17802024-12-20T22:32:00.575ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
17812024-12-20T22:32:00.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17822024-12-20T22:32:00.575ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
17832024-12-20T22:32:00.576ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17842024-12-20T22:32:00.576ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:22:00.571718716 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
17852024-12-20T22:32:00.576ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.625988ms iteration = 7 status = {"expiration":"2024-12-20T22:22:00.571718716Z","pruned":[]}
17862024-12-20T22:32:00.576ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17872024-12-20T22:32:00.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17882024-12-20T22:32:00.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17892024-12-20T22:32:00.577ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17902024-12-20T22:32:00.579ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
17912024-12-20T22:32:00.579ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17922024-12-20T22:32:00.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17932024-12-20T22:32:00.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
17942024-12-20T22:32:00.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17952024-12-20T22:32:00.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17962024-12-20T22:32:00.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17972024-12-20T22:32:00.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17982024-12-20T22:32:00.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17992024-12-20T22:32:00.582ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.403149ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
18002024-12-20T22:32:00.583ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18012024-12-20T22:32:00.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18022024-12-20T22:32:00.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
18032024-12-20T22:32:00.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
18042024-12-20T22:32:00.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
18052024-12-20T22:32:00.585ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18062024-12-20T22:32:00.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18072024-12-20T22:32:00.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18082024-12-20T22:32:00.586ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18092024-12-20T22:32:00.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18102024-12-20T22:32:00.587ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.662145ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
18112024-12-20T22:32:00.588ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18122024-12-20T22:32:00.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18132024-12-20T22:32:00.588ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18142024-12-20T22:32:00.589ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18152024-12-20T22:32:00.589ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18162024-12-20T22:32:00.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18172024-12-20T22:32:00.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18182024-12-20T22:32:00.592ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18192024-12-20T22:32:00.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
18202024-12-20T22:32:00.592ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
18212024-12-20T22:32:00.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18222024-12-20T22:32:00.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
18232024-12-20T22:32:00.595ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18242024-12-20T22:32:00.595ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18252024-12-20T22:32:00.597ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18262024-12-20T22:32:00.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18272024-12-20T22:32:00.598ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18282024-12-20T22:32:00.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18292024-12-20T22:32:00.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18302024-12-20T22:32:00.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18312024-12-20T22:32:00.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18322024-12-20T22:32:00.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18332024-12-20T22:32:00.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18342024-12-20T22:32:00.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18352024-12-20T22:32:00.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18362024-12-20T22:32:00.607ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18372024-12-20T22:32:00.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18382024-12-20T22:32:00.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
18392024-12-20T22:32:00.609ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18402024-12-20T22:32:00.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18412024-12-20T22:32:00.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18422024-12-20T22:32:00.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18432024-12-20T22:32:00.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18442024-12-20T22:32:00.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18452024-12-20T22:32:00.612ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1068, tv_nsec: 224794586 } })
18462024-12-20T22:32:00.612ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
18472024-12-20T22:32:00.614ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 41.3223ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
18482024-12-20T22:32:00.614ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18492024-12-20T22:32:00.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18502024-12-20T22:32:00.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18512024-12-20T22:32:00.618ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18522024-12-20T22:32:00.618ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18532024-12-20T22:32:00.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18542024-12-20T22:32:00.618ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18552024-12-20T22:32:00.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18562024-12-20T22:32:00.618ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18572024-12-20T22:32:00.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18582024-12-20T22:32:00.622ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18592024-12-20T22:32:00.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
18602024-12-20T22:32:00.628ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18612024-12-20T22:32:00.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18622024-12-20T22:32:00.649ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 77.039966ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
18632024-12-20T22:32:00.651ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18642024-12-20T22:32:00.652ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18652024-12-20T22:32:00.652ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
18662024-12-20T22:32:00.652ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18672024-12-20T22:32:00.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18682024-12-20T22:32:00.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18692024-12-20T22:32:00.655ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18702024-12-20T22:32:00.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18712024-12-20T22:32:00.657ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18722024-12-20T22:32:00.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18732024-12-20T22:32:00.658ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18742024-12-20T22:32:00.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18752024-12-20T22:32:00.658ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18762024-12-20T22:32:00.658ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
18772024-12-20T22:32:00.658ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18782024-12-20T22:32:00.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18792024-12-20T22:32:00.660ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18802024-12-20T22:32:00.661ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18812024-12-20T22:32:00.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18822024-12-20T22:32:00.661ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18832024-12-20T22:32:00.664ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
18842024-12-20T22:32:00.664ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18852024-12-20T22:32:00.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18862024-12-20T22:32:00.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
18872024-12-20T22:32:00.664ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18882024-12-20T22:32:00.664ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 91.915976ms iteration = 15 status = {"physical_disks_added":0}
18892024-12-20T22:32:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18902024-12-20T22:32:00.665ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18912024-12-20T22:32:00.666ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
18922024-12-20T22:32:00.666ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
18932024-12-20T22:32:00.666ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 93.372807ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
18942024-12-20T22:32:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
18952024-12-20T22:32:00.667ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18962024-12-20T22:32:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18972024-12-20T22:32:00.674ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 101.234244ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18982024-12-20T22:32:00.674ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18992024-12-20T22:32:00.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19002024-12-20T22:32:00.677ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19012024-12-20T22:32:00.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
19022024-12-20T22:32:00.680ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19032024-12-20T22:32:00.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19042024-12-20T22:32:00.682ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 109.482171ms iteration = 13 status = 0
19052024-12-20T22:32:00.686ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
19062024-12-20T22:32:00.686ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
19072024-12-20T22:32:00.686ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
19082024-12-20T22:32:00.686ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19092024-12-20T22:32:00.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19102024-12-20T22:32:00.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19112024-12-20T22:32:00.690ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19122024-12-20T22:32:00.690ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19132024-12-20T22:32:00.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19142024-12-20T22:32:00.691ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19152024-12-20T22:32:00.693ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
19162024-12-20T22:32:00.693ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
19172024-12-20T22:32:00.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19182024-12-20T22:32:00.693ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
19192024-12-20T22:32:00.693ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
19202024-12-20T22:32:00.693ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
19212024-12-20T22:32:00.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19222024-12-20T22:32:00.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19232024-12-20T22:32:00.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19242024-12-20T22:32:00.694ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19252024-12-20T22:32:00.694ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19262024-12-20T22:32:00.694ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19272024-12-20T22:32:00.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19282024-12-20T22:32:00.695ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19292024-12-20T22:32:00.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19302024-12-20T22:32:00.699ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19312024-12-20T22:32:00.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19322024-12-20T22:32:00.700ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 127.847699ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19332024-12-20T22:32:00.702ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 129.568805ms iteration = 4 status = {"nsuccess":5}
19342024-12-20T22:32:00.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19352024-12-20T22:32:00.702ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19362024-12-20T22:32:00.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19372024-12-20T22:32:00.702ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19382024-12-20T22:32:00.703ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
19392024-12-20T22:32:00.703ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 0 version = 2
19402024-12-20T22:32:00.703ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19412024-12-20T22:32:00.703ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19422024-12-20T22:32:00.703ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 130.48118ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19432024-12-20T22:32:00.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19442024-12-20T22:32:00.706ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
19452024-12-20T22:32:00.706ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19462024-12-20T22:32:00.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19472024-12-20T22:32:00.706ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
19482024-12-20T22:32:00.707ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19492024-12-20T22:32:00.708ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
19502024-12-20T22:32:00.708ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
19512024-12-20T22:32:00.708ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
19522024-12-20T22:32:00.708ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:26:39.700273 UTC dns_group = internal generation = 1
19532024-12-20T22:32:00.708ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
19542024-12-20T22:32:00.708ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 137.157695ms iteration = 7 status = {"generation":1}
19552024-12-20T22:32:00.708ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 135.962802ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
19562024-12-20T22:32:00.708ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 135.928241ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
19572024-12-20T22:32:00.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19582024-12-20T22:32:00.711ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19592024-12-20T22:32:00.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19602024-12-20T22:32:00.713ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 1 version = 2
19612024-12-20T22:32:00.713ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
19622024-12-20T22:32:00.713ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:26:40.428768 UTC dns_group = external generation = 2
19632024-12-20T22:32:00.713ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 141.751712ms iteration = 7 status = {"generation":2}
19642024-12-20T22:32:00.717ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19652024-12-20T22:32:00.717ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19662024-12-20T22:32:00.717ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 144.2296ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
19672024-12-20T22:32:00.718ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
19682024-12-20T22:32:00.718ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 146.877274ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
19692024-12-20T22:32:00.730ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:25:57.040586Z, time_modified: 2024-12-20T22:25:57.040586Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }) }
19702024-12-20T22:32:00.731ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 159.269026ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]}},"default_endpoint":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
19712024-12-20T22:32:00.739ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
19722024-12-20T22:32:00.741ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
19732024-12-20T22:32:00.741ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19742024-12-20T22:32:00.742ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a607b1f-1e72-4849-af19-a9263c25711d", "content-length": "26", "date": "Fri, 20 Dec 2024 22:32:00 GMT"} })
19752024-12-20T22:32:00.742ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19762024-12-20T22:32:00.743ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19772024-12-20T22:32:00.790ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
19782024-12-20T22:32:00.790ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 217.502792ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
19792024-12-20T22:32:00.794ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19802024-12-20T22:32:00.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19812024-12-20T22:32:00.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19822024-12-20T22:32:00.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19832024-12-20T22:32:00.818ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
19842024-12-20T22:32:00.818ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19852024-12-20T22:32:00.818ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "40bff774-ac7b-4759-865e-16368cbfb85d", "content-length": "26", "date": "Fri, 20 Dec 2024 22:32:00 GMT"} })
19862024-12-20T22:32:00.818ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19872024-12-20T22:32:00.820ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19882024-12-20T22:32:00.848ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 zone_address = fd00:1122:3344:101::2
19892024-12-20T22:32:00.848ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19902024-12-20T22:32:00.848ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e26c5a8-e96a-4572-b514-43918ddb9d61", "content-length": "26", "date": "Fri, 20 Dec 2024 22:32:00 GMT"} })
19912024-12-20T22:32:00.848ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19922024-12-20T22:32:00.850ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
19932024-12-20T22:32:00.869ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
19942024-12-20T22:32:00.869ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "062ad0ac-6cde-4edc-a8cd-9676e2900e1b", "date": "Fri, 20 Dec 2024 22:31:59 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19952024-12-20T22:32:00.869ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19962024-12-20T22:32:00.870ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "04d05181-9616-4b35-aaa9-0f72c3b98ee8", "date": "Fri, 20 Dec 2024 22:31:59 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19972024-12-20T22:32:00.870ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19982024-12-20T22:32:00.872ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
19992024-12-20T22:32:00.872ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 300.592365ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
20002024-12-20T22:32:00.897ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
20012024-12-20T22:32:00.910ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 339.094968ms iteration = 13 status = {}
20022024-12-20T22:32:00.911ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
20032024-12-20T22:32:00.911ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20042024-12-20T22:32:00.912ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8a9e117-75b5-47a7-96ed-b3c1a9899950", "content-length": "372", "date": "Fri, 20 Dec 2024 22:32:00 GMT"} })
20052024-12-20T22:32:00.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20062024-12-20T22:32:00.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20072024-12-20T22:32:00.913ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20082024-12-20T22:32:00.915ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20092024-12-20T22:32:00.915ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20102024-12-20T22:32:00.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20112024-12-20T22:32:00.916ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20122024-12-20T22:32:00.918ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20132024-12-20T22:32:00.918ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20142024-12-20T22:32:00.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20152024-12-20T22:32:00.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e51683b4-81f6-48f5-ad4d-72491ce4633e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
20162024-12-20T22:32:00.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e51683b4-81f6-48f5-ad4d-72491ce4633e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
20172024-12-20T22:32:00.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1595 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e51683b4-81f6-48f5-ad4d-72491ce4633e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
20182024-12-20T22:32:00.972ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
20192024-12-20T22:32:00.972ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
20202024-12-20T22:32:00.973ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "45a78ecc-e838-4edb-8240-a764037616f6", "date": "Fri, 20 Dec 2024 22:32:00 GMT"} })
20212024-12-20T22:32:00.973ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20222024-12-20T22:32:00.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20232024-12-20T22:32:00.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20242024-12-20T22:32:00.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20252024-12-20T22:32:00.978ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20262024-12-20T22:32:00.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20272024-12-20T22:32:01.019ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
20282024-12-20T22:32:01.020ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "facea2d6-bf5c-4101-aeed-04c2d9d0d28d", "date": "Fri, 20 Dec 2024 22:32:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20292024-12-20T22:32:01.020ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20302024-12-20T22:32:01.021ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "24af47a1-ccb3-4f15-8611-b9fb57153574", "date": "Fri, 20 Dec 2024 22:32:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20312024-12-20T22:32:01.021ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20322024-12-20T22:32:01.023ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5eeb20eb-a917-4414-a372-ec4c516c8e88", "date": "Fri, 20 Dec 2024 22:32:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20332024-12-20T22:32:01.023ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20342024-12-20T22:32:01.025ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20352024-12-20T22:32:01.025ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 453.356051ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
20362024-12-20T22:32:01.030ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
20372024-12-20T22:32:01.030ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "22deffd7-d517-4ea7-a4ff-d0b805502bef", "content-length": "1", "date": "Fri, 20 Dec 2024 22:32:00 GMT"} })
20382024-12-20T22:32:01.031ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20392024-12-20T22:32:01.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20402024-12-20T22:32:01.032ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20412024-12-20T22:32:01.032ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f47c52d0-06a1-4dc7-9ce7-ca6b32df76dc", "content-length": "691", "date": "Fri, 20 Dec 2024 22:32:00 GMT"} })
20422024-12-20T22:32:01.032ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
20432024-12-20T22:32:01.032ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
20442024-12-20T22:32:01.032ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
20452024-12-20T22:32:01.033ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 461.036133ms iteration = 13 status = {}
20462024-12-20T22:32:01.035ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 463.388458ms iteration = 13 status = null
20472024-12-20T22:32:01.035ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20482024-12-20T22:32:01.035ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20492024-12-20T22:32:01.036ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3c4fdc43-9424-430b-9b8a-cc81f6df3c6e", "date": "Fri, 20 Dec 2024 22:32:00 GMT"} })
20502024-12-20T22:32:01.038ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 465.26792ms iteration = 13 status = {}
20512024-12-20T22:32:01.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20522024-12-20T22:32:01.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20532024-12-20T22:32:01.106ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9fedf0d4-8a86-4506-bf93-224faabd5e37, rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b26f0563-25fb-4d7c-8480-dd368ac01105) } rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
20542024-12-20T22:32:01.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20552024-12-20T22:32:01.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20562024-12-20T22:32:01.114ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
20572024-12-20T22:32:01.114ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a49d79ae-fe81-4a00-92cc-bf7511ed0ed0", "content-length": "134", "date": "Fri, 20 Dec 2024 22:32:00 GMT"} })
20582024-12-20T22:32:01.114ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
20592024-12-20T22:32:01.114ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b26f0563-25fb-4d7c-8480-dd368ac01105
20602024-12-20T22:32:01.115ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
20612024-12-20T22:32:01.115ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20622024-12-20T22:32:01.115ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20632024-12-20T22:32:01.115ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20642024-12-20T22:32:01.115ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20652024-12-20T22:32:01.115ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20662024-12-20T22:32:01.115ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20672024-12-20T22:32:01.115ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20682024-12-20T22:32:01.115ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
20692024-12-20T22:32:01.115ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20702024-12-20T22:32:01.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20712024-12-20T22:32:01.117ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
20722024-12-20T22:32:01.117ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "00d0f558-9019-4a6f-aa27-c92acc91fa54", "content-length": "2", "date": "Fri, 20 Dec 2024 22:32:00 GMT"} })
20732024-12-20T22:32:01.117ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
20742024-12-20T22:32:01.117ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e971df3-726f-4916-b400-3cbafc2b352a", "content-length": "52", "date": "Fri, 20 Dec 2024 22:32:01 GMT"} })
20752024-12-20T22:32:01.117ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
20762024-12-20T22:32:01.117ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
20772024-12-20T22:32:01.197ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
20782024-12-20T22:32:01.197ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
20792024-12-20T22:32:01.228ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
20802024-12-20T22:32:01.228ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:50563
20812024-12-20T22:32:01.228ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e9439f4c-9fe4-4e83-b9b5-f8146c1f3269", "date": "Fri, 20 Dec 2024 22:32:00 GMT"} })
20822024-12-20T22:32:01.228ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch = Switch0
20832024-12-20T22:32:01.228ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20842024-12-20T22:32:01.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:50563 req_id = cabe98cd-f255-4ffb-84ee-5a198dc0e615 roles = RoleSet { roles: {} } uri = /metrics/producers
20852024-12-20T22:32:01.228ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7a4c872-ce00-48d3-9226-8d3967caa58a", "content-length": "682", "date": "Fri, 20 Dec 2024 22:32:00 GMT"} })
20862024-12-20T22:32:01.228ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20872024-12-20T22:32:01.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:50563 req_id = cabe98cd-f255-4ffb-84ee-5a198dc0e615 resource = Database result = Ok(()) uri = /metrics/producers
20882024-12-20T22:32:01.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20892024-12-20T22:32:01.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20902024-12-20T22:32:01.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20912024-12-20T22:32:01.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20922024-12-20T22:32:01.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20932024-12-20T22:32:01.237ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20942024-12-20T22:32:01.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20952024-12-20T22:32:01.244ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 671.870482ms iteration = 13 status = {}
20962024-12-20T22:32:01.278ZINFOnexus: assigned collector to new producer collector_id = a0c68cf7-84ce-4a59-a3f9-ff7d332963b9 file = nexus/src/app/oximeter.rs:76 producer_id = c08fb79e-9df2-49bb-be41-3925df103e75
20972024-12-20T22:32:01.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49714 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:50563 req_id = cabe98cd-f255-4ffb-84ee-5a198dc0e615 response_code = 201 uri = /metrics/producers
20982024-12-20T22:32:01.278ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "cabe98cd-f255-4ffb-84ee-5a198dc0e615", "content-length": "41", "date": "Fri, 20 Dec 2024 22:32:01 GMT"} })
20992024-12-20T22:32:01.279ZDEBGnexus (producer-registration-task): registered with nexus successfully
21002024-12-20T22:32:01.279ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
21012024-12-20T22:32:01.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 694199d7-8ede-4a35-bd33-3ad28c863ee2 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21022024-12-20T22:32:01.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 694199d7-8ede-4a35-bd33-3ad28c863ee2 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21032024-12-20T22:32:01.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 694199d7-8ede-4a35-bd33-3ad28c863ee2 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21042024-12-20T22:32:02.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f68e8401-acb5-431c-bccb-28014ac14201 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21052024-12-20T22:32:02.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f68e8401-acb5-431c-bccb-28014ac14201 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21062024-12-20T22:32:02.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f68e8401-acb5-431c-bccb-28014ac14201 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21072024-12-20T22:32:03.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = dcd3e78b-ed9b-4a8c-8fe5-c6819e3dcc2c roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21082024-12-20T22:32:03.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = dcd3e78b-ed9b-4a8c-8fe5-c6819e3dcc2c resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21092024-12-20T22:32:03.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = dcd3e78b-ed9b-4a8c-8fe5-c6819e3dcc2c response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21102024-12-20T22:32:05.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 52ce6271-cfeb-47aa-b9da-67f48ff8cfcb roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21112024-12-20T22:32:05.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 52ce6271-cfeb-47aa-b9da-67f48ff8cfcb resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21122024-12-20T22:32:05.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 52ce6271-cfeb-47aa-b9da-67f48ff8cfcb response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21132024-12-20T22:32:05.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 635 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = b73b773f-7844-4784-b116-fcfbe9d0b1f9 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
21142024-12-20T22:32:06.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 922aa875-05d5-4113-91a3-e4a2da75c106 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21152024-12-20T22:32:06.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 922aa875-05d5-4113-91a3-e4a2da75c106 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21162024-12-20T22:32:06.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 922aa875-05d5-4113-91a3-e4a2da75c106 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21172024-12-20T22:32:07.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e2ed66d5-1293-4614-b927-76325c1424e1 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21182024-12-20T22:32:07.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e2ed66d5-1293-4614-b927-76325c1424e1 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21192024-12-20T22:32:07.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1943 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e2ed66d5-1293-4614-b927-76325c1424e1 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21202024-12-20T22:32:08.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c9350890-d0e0-44c5-900e-494bc7f0e195 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21212024-12-20T22:32:08.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c9350890-d0e0-44c5-900e-494bc7f0e195 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21222024-12-20T22:32:08.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2787 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c9350890-d0e0-44c5-900e-494bc7f0e195 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21232024-12-20T22:32:09.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e0c15635-dc2f-4ad7-8c86-7a088fde7508 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21242024-12-20T22:32:09.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e0c15635-dc2f-4ad7-8c86-7a088fde7508 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21252024-12-20T22:32:09.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e0c15635-dc2f-4ad7-8c86-7a088fde7508 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21262024-12-20T22:32:10.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 77054bc8-8496-4a0d-8af6-76b4d4a81d3f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21272024-12-20T22:32:10.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 77054bc8-8496-4a0d-8af6-76b4d4a81d3f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21282024-12-20T22:32:10.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 77054bc8-8496-4a0d-8af6-76b4d4a81d3f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21292024-12-20T22:32:10.571ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
21302024-12-20T22:32:10.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21312024-12-20T22:32:10.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21322024-12-20T22:32:10.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
21332024-12-20T22:32:10.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21342024-12-20T22:32:10.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21352024-12-20T22:32:10.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21362024-12-20T22:32:10.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21372024-12-20T22:32:10.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21382024-12-20T22:32:10.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21392024-12-20T22:32:10.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21402024-12-20T22:32:10.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21412024-12-20T22:32:10.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21422024-12-20T22:32:10.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21432024-12-20T22:32:10.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21442024-12-20T22:32:10.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
21452024-12-20T22:32:10.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21462024-12-20T22:32:10.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21472024-12-20T22:32:10.593ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
21482024-12-20T22:32:10.593ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.939906ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
21492024-12-20T22:32:10.614ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 41.567267ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21502024-12-20T22:32:11.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 431a853c-afc5-4430-9e29-3e0cc18e960a roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21512024-12-20T22:32:11.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 431a853c-afc5-4430-9e29-3e0cc18e960a resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21522024-12-20T22:32:11.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 431a853c-afc5-4430-9e29-3e0cc18e960a response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21532024-12-20T22:32:12.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a3167b81-50b1-452c-bdaf-3f4836ed6720 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21542024-12-20T22:32:12.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a3167b81-50b1-452c-bdaf-3f4836ed6720 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21552024-12-20T22:32:12.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a3167b81-50b1-452c-bdaf-3f4836ed6720 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21562024-12-20T22:32:13.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 58fc8fa7-1b12-457c-aa6f-d90afdb88fab roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21572024-12-20T22:32:13.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 58fc8fa7-1b12-457c-aa6f-d90afdb88fab resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21582024-12-20T22:32:13.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 58fc8fa7-1b12-457c-aa6f-d90afdb88fab response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21592024-12-20T22:32:14.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f24089ae-d2bc-4f79-abb9-0b6486311750 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21602024-12-20T22:32:14.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f24089ae-d2bc-4f79-abb9-0b6486311750 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21612024-12-20T22:32:14.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f24089ae-d2bc-4f79-abb9-0b6486311750 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21622024-12-20T22:32:15.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 05c88245-7794-49b1-a9fb-4cc9ef022e67 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21632024-12-20T22:32:15.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 05c88245-7794-49b1-a9fb-4cc9ef022e67 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21642024-12-20T22:32:15.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 05c88245-7794-49b1-a9fb-4cc9ef022e67 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21652024-12-20T22:32:15.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 602 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 6c8343d8-a669-4317-8df1-59c55b162591 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
21662024-12-20T22:32:16.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f13e77d3-7786-45a4-8184-d9cd47235927 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21672024-12-20T22:32:16.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f13e77d3-7786-45a4-8184-d9cd47235927 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21682024-12-20T22:32:16.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f13e77d3-7786-45a4-8184-d9cd47235927 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21692024-12-20T22:32:17.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d83036af-ae5b-4631-b2ab-da4bb4fa68e3 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21702024-12-20T22:32:17.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d83036af-ae5b-4631-b2ab-da4bb4fa68e3 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21712024-12-20T22:32:17.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d83036af-ae5b-4631-b2ab-da4bb4fa68e3 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21722024-12-20T22:32:18.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0e7e816c-c009-40e4-9ffc-1d4de9d6c60f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21732024-12-20T22:32:18.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0e7e816c-c009-40e4-9ffc-1d4de9d6c60f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21742024-12-20T22:32:18.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0e7e816c-c009-40e4-9ffc-1d4de9d6c60f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21752024-12-20T22:32:19.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9c86d4d4-80c5-4ad7-976d-1c79f81a5827 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21762024-12-20T22:32:19.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9c86d4d4-80c5-4ad7-976d-1c79f81a5827 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21772024-12-20T22:32:19.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9c86d4d4-80c5-4ad7-976d-1c79f81a5827 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21782024-12-20T22:32:20.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d627e75b-b545-4715-ab38-78ea7346e85d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21792024-12-20T22:32:20.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d627e75b-b545-4715-ab38-78ea7346e85d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21802024-12-20T22:32:20.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d627e75b-b545-4715-ab38-78ea7346e85d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
21812024-12-20T22:32:20.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
21822024-12-20T22:32:20.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21832024-12-20T22:32:20.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21842024-12-20T22:32:20.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
21852024-12-20T22:32:20.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21862024-12-20T22:32:20.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21872024-12-20T22:32:20.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21882024-12-20T22:32:20.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21892024-12-20T22:32:20.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21902024-12-20T22:32:20.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.050391ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21912024-12-20T22:32:20.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21922024-12-20T22:32:20.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21932024-12-20T22:32:20.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21942024-12-20T22:32:20.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21952024-12-20T22:32:20.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21962024-12-20T22:32:20.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21972024-12-20T22:32:20.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
21982024-12-20T22:32:20.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21992024-12-20T22:32:20.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22002024-12-20T22:32:20.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
22012024-12-20T22:32:20.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.608331ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
22022024-12-20T22:32:21.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 56b5319a-3efe-4988-a99e-31528f2c8816 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22032024-12-20T22:32:21.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 56b5319a-3efe-4988-a99e-31528f2c8816 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22042024-12-20T22:32:21.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2295 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 56b5319a-3efe-4988-a99e-31528f2c8816 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22052024-12-20T22:32:22.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a6dc4c41-dfe6-496a-a268-c3e648328b52 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22062024-12-20T22:32:22.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a6dc4c41-dfe6-496a-a268-c3e648328b52 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22072024-12-20T22:32:22.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a6dc4c41-dfe6-496a-a268-c3e648328b52 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22082024-12-20T22:32:23.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 17580d68-9c51-49d4-8f99-4e71336ea64c roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22092024-12-20T22:32:23.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 17580d68-9c51-49d4-8f99-4e71336ea64c resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22102024-12-20T22:32:23.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 17580d68-9c51-49d4-8f99-4e71336ea64c response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22112024-12-20T22:32:24.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5fe8ed9f-58a6-47ca-9ac1-ccd17231bb44 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22122024-12-20T22:32:24.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5fe8ed9f-58a6-47ca-9ac1-ccd17231bb44 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22132024-12-20T22:32:24.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5fe8ed9f-58a6-47ca-9ac1-ccd17231bb44 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22142024-12-20T22:32:25.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 530 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 070b73c3-b1f3-4fad-a815-0b34bc82b4d9 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
22152024-12-20T22:32:25.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = be22189f-d394-4fcf-8bc2-5b599747b0e1 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22162024-12-20T22:32:25.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = be22189f-d394-4fcf-8bc2-5b599747b0e1 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22172024-12-20T22:32:25.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1555 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = be22189f-d394-4fcf-8bc2-5b599747b0e1 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22182024-12-20T22:32:26.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 72bea0d3-361a-48da-8e94-b199eb0e903b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22192024-12-20T22:32:26.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 72bea0d3-361a-48da-8e94-b199eb0e903b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22202024-12-20T22:32:26.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 72bea0d3-361a-48da-8e94-b199eb0e903b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22212024-12-20T22:32:27.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4f97ac46-cf2a-4ca8-a989-4b772206b579 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22222024-12-20T22:32:27.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4f97ac46-cf2a-4ca8-a989-4b772206b579 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22232024-12-20T22:32:27.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4f97ac46-cf2a-4ca8-a989-4b772206b579 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22242024-12-20T22:32:28.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 15fe1938-4407-417f-9ff1-02a03f2caefc roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22252024-12-20T22:32:28.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 15fe1938-4407-417f-9ff1-02a03f2caefc resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22262024-12-20T22:32:28.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 15fe1938-4407-417f-9ff1-02a03f2caefc response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22272024-12-20T22:32:29.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 56e1859c-2851-4cd9-b722-7a43af337a05 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22282024-12-20T22:32:29.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 56e1859c-2851-4cd9-b722-7a43af337a05 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22292024-12-20T22:32:29.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 56e1859c-2851-4cd9-b722-7a43af337a05 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22302024-12-20T22:32:30.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 3ece887c-8dd1-4c72-953c-ffcd65001926 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
22312024-12-20T22:32:30.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 3ece887c-8dd1-4c72-953c-ffcd65001926 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
22322024-12-20T22:32:30.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 3ece887c-8dd1-4c72-953c-ffcd65001926 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
22332024-12-20T22:32:30.571ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
22342024-12-20T22:32:30.571ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
22352024-12-20T22:32:30.571ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22362024-12-20T22:32:30.571ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
22372024-12-20T22:32:30.571ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
22382024-12-20T22:32:30.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22392024-12-20T22:32:30.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
22402024-12-20T22:32:30.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
22412024-12-20T22:32:30.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22422024-12-20T22:32:30.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22432024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
22442024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
22452024-12-20T22:32:30.573ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
22462024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
22472024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
22482024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22492024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22502024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
22512024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22522024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
22532024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22542024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
22552024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
22562024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22572024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
22582024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22592024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
22602024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22612024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
22622024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22632024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22642024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
22652024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22662024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
22672024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22682024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22692024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
22702024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
22712024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22722024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22732024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22742024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
22752024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22762024-12-20T22:32:30.573ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1098, tv_nsec: 186109458 } })
22772024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22782024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22792024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22802024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22812024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
22822024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22832024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22842024-12-20T22:32:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22852024-12-20T22:32:30.573ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
22862024-12-20T22:32:30.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1098, tv_nsec: 187155357 } })
22872024-12-20T22:32:30.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
22882024-12-20T22:32:30.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22892024-12-20T22:32:30.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22902024-12-20T22:32:30.575ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.325399ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
22912024-12-20T22:32:30.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6712f6ff-4cae-4f20-b499-59240c94f67b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22922024-12-20T22:32:30.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6712f6ff-4cae-4f20-b499-59240c94f67b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
22932024-12-20T22:32:30.576ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.898877ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
22942024-12-20T22:32:30.577ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22952024-12-20T22:32:30.577ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22962024-12-20T22:32:30.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22972024-12-20T22:32:30.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22982024-12-20T22:32:30.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22992024-12-20T22:32:30.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23002024-12-20T22:32:30.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23012024-12-20T22:32:30.580ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23022024-12-20T22:32:30.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23032024-12-20T22:32:30.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.470024ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
23042024-12-20T22:32:30.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
23052024-12-20T22:32:30.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23062024-12-20T22:32:30.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23072024-12-20T22:32:30.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23082024-12-20T22:32:30.583ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23092024-12-20T22:32:30.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23102024-12-20T22:32:30.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
23112024-12-20T22:32:30.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23122024-12-20T22:32:30.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23132024-12-20T22:32:30.584ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23142024-12-20T22:32:30.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23152024-12-20T22:32:30.585ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23162024-12-20T22:32:30.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11501 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6712f6ff-4cae-4f20-b499-59240c94f67b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
23172024-12-20T22:32:30.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23182024-12-20T22:32:30.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23192024-12-20T22:32:30.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23202024-12-20T22:32:30.588ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1098, tv_nsec: 201312518 } })
23212024-12-20T22:32:30.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
23222024-12-20T22:32:30.589ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23232024-12-20T22:32:30.589ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
23242024-12-20T22:32:30.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23252024-12-20T22:32:30.589ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23262024-12-20T22:32:30.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23272024-12-20T22:32:30.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23282024-12-20T22:32:30.591ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 18.309146ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23292024-12-20T22:32:30.591ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23302024-12-20T22:32:30.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23312024-12-20T22:32:30.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23322024-12-20T22:32:30.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23332024-12-20T22:32:30.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23342024-12-20T22:32:30.593ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23352024-12-20T22:32:30.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
23362024-12-20T22:32:30.595ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23372024-12-20T22:32:30.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23382024-12-20T22:32:30.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23392024-12-20T22:32:30.595ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23402024-12-20T22:32:30.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23412024-12-20T22:32:30.596ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
23422024-12-20T22:32:30.596ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 23.849958ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
23432024-12-20T22:32:30.601ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 28.800445ms iteration = 16 status = {"physical_disks_added":0}
23442024-12-20T22:32:30.612ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
23452024-12-20T22:32:30.612ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 40.333693ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
23462024-12-20T22:32:30.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23472024-12-20T22:32:30.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23482024-12-20T22:32:30.615ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23492024-12-20T22:32:30.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23502024-12-20T22:32:30.616ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23512024-12-20T22:32:30.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
23522024-12-20T22:32:30.619ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23532024-12-20T22:32:30.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23542024-12-20T22:32:30.621ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 48.228891ms iteration = 14 status = 0
23552024-12-20T22:32:30.623ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23562024-12-20T22:32:30.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23572024-12-20T22:32:30.626ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23582024-12-20T22:32:30.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23592024-12-20T22:32:30.628ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23602024-12-20T22:32:30.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23612024-12-20T22:32:30.642ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23622024-12-20T22:32:30.642ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
23632024-12-20T22:32:30.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23642024-12-20T22:32:30.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23652024-12-20T22:32:30.645ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23662024-12-20T22:32:30.645ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
23672024-12-20T22:32:30.645ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23682024-12-20T22:32:30.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23692024-12-20T22:32:30.656ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
23702024-12-20T22:32:30.656ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23712024-12-20T22:32:30.657ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4ac7124-ebf9-4c57-8cc7-32c9cc871e10", "content-length": "26", "date": "Fri, 20 Dec 2024 22:32:30 GMT"} })
23722024-12-20T22:32:30.657ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23732024-12-20T22:32:30.658ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
23742024-12-20T22:32:30.658ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23752024-12-20T22:32:30.658ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23762024-12-20T22:32:30.658ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bf5819a-160c-4338-ba75-4f16eb281082", "content-length": "26", "date": "Fri, 20 Dec 2024 22:32:30 GMT"} })
23772024-12-20T22:32:30.658ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23782024-12-20T22:32:30.660ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23792024-12-20T22:32:30.675ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 zone_address = fd00:1122:3344:101::2
23802024-12-20T22:32:30.675ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23812024-12-20T22:32:30.675ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cc433d9-5fe3-47dc-9ff8-6b2f5f1305db", "content-length": "26", "date": "Fri, 20 Dec 2024 22:32:30 GMT"} })
23822024-12-20T22:32:30.675ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23832024-12-20T22:32:30.677ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
23842024-12-20T22:32:30.678ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
23852024-12-20T22:32:30.678ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23862024-12-20T22:32:30.678ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0102ce87-e8f1-4a36-94f3-a112d77c76af", "content-length": "372", "date": "Fri, 20 Dec 2024 22:32:29 GMT"} })
23872024-12-20T22:32:30.678ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23882024-12-20T22:32:30.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23892024-12-20T22:32:30.679ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23902024-12-20T22:32:30.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23912024-12-20T22:32:30.680ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 107.561248ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23922024-12-20T22:32:30.681ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 108.883454ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23932024-12-20T22:32:30.696ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23942024-12-20T22:32:30.696ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
23952024-12-20T22:32:30.696ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 123.264452ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
23962024-12-20T22:32:30.734ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 161.570049ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
23972024-12-20T22:32:30.736ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23982024-12-20T22:32:30.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23992024-12-20T22:32:30.744ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24002024-12-20T22:32:30.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24012024-12-20T22:32:30.745ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
24022024-12-20T22:32:30.745ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
24032024-12-20T22:32:30.746ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "52bd7eba-60eb-4518-985d-ab0ee5b94bf9", "date": "Fri, 20 Dec 2024 22:32:29 GMT"} })
24042024-12-20T22:32:30.746ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24052024-12-20T22:32:30.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24062024-12-20T22:32:30.747ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24072024-12-20T22:32:30.748ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
24082024-12-20T22:32:30.748ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0a4b726-deca-46fd-90ca-d8443aea447b", "content-length": "1", "date": "Fri, 20 Dec 2024 22:32:30 GMT"} })
24092024-12-20T22:32:30.748ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24102024-12-20T22:32:30.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24112024-12-20T22:32:30.749ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24122024-12-20T22:32:30.749ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24132024-12-20T22:32:30.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24142024-12-20T22:32:30.750ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24152024-12-20T22:32:30.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24162024-12-20T22:32:30.751ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24172024-12-20T22:32:30.752ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24182024-12-20T22:32:30.752ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 181.861539ms iteration = 14 status = null
24192024-12-20T22:32:30.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24202024-12-20T22:32:30.753ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24212024-12-20T22:32:30.753ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24222024-12-20T22:32:30.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24232024-12-20T22:32:30.756ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
24242024-12-20T22:32:30.756ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24252024-12-20T22:32:30.757ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 186.185448ms iteration = 14 status = {}
24262024-12-20T22:32:30.757ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "404ecbe1-b108-4d52-8c30-4dd721371a09", "date": "Fri, 20 Dec 2024 22:32:29 GMT"} })
24272024-12-20T22:32:30.759ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 186.28193ms iteration = 14 status = {}
24282024-12-20T22:32:30.827ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24292024-12-20T22:32:30.827ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb0a9a09-f104-450f-88fc-a4839abe6c2c", "content-length": "691", "date": "Fri, 20 Dec 2024 22:32:29 GMT"} })
24302024-12-20T22:32:30.827ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
24312024-12-20T22:32:30.827ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
24322024-12-20T22:32:30.827ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
24332024-12-20T22:32:30.829ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 256.953221ms iteration = 14 status = {}
24342024-12-20T22:32:30.859ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24352024-12-20T22:32:30.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24362024-12-20T22:32:30.862ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9fedf0d4-8a86-4506-bf93-224faabd5e37, rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b26f0563-25fb-4d7c-8480-dd368ac01105) } rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
24372024-12-20T22:32:30.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24382024-12-20T22:32:30.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24392024-12-20T22:32:30.871ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
24402024-12-20T22:32:30.872ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "70a09667-e8bd-44eb-80fd-543516eca898", "content-length": "134", "date": "Fri, 20 Dec 2024 22:32:30 GMT"} })
24412024-12-20T22:32:30.872ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
24422024-12-20T22:32:30.872ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b26f0563-25fb-4d7c-8480-dd368ac01105
24432024-12-20T22:32:30.872ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
24442024-12-20T22:32:30.872ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24452024-12-20T22:32:30.872ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24462024-12-20T22:32:30.872ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24472024-12-20T22:32:30.872ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24482024-12-20T22:32:30.872ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24492024-12-20T22:32:30.872ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24502024-12-20T22:32:30.872ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24512024-12-20T22:32:30.872ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
24522024-12-20T22:32:30.872ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24532024-12-20T22:32:30.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24542024-12-20T22:32:30.874ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
24552024-12-20T22:32:30.875ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "660e031a-d776-49ca-85c2-c8cb884ea002", "content-length": "2", "date": "Fri, 20 Dec 2024 22:32:30 GMT"} })
24562024-12-20T22:32:30.875ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
24572024-12-20T22:32:30.875ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ec98416-81e9-4a85-b4fc-ead821509eab", "content-length": "52", "date": "Fri, 20 Dec 2024 22:32:30 GMT"} })
24582024-12-20T22:32:30.875ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
24592024-12-20T22:32:30.875ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24602024-12-20T22:32:30.976ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2ebe7e9d-0603-4297-b662-e9f6c8eb8e21", "date": "Fri, 20 Dec 2024 22:32:30 GMT"} })
24612024-12-20T22:32:30.976ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch = Switch0
24622024-12-20T22:32:30.976ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24632024-12-20T22:32:30.976ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ab535c2-10c2-47be-8637-53f6705d7643", "content-length": "682", "date": "Fri, 20 Dec 2024 22:32:30 GMT"} })
24642024-12-20T22:32:30.976ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24652024-12-20T22:32:30.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24662024-12-20T22:32:30.980ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24672024-12-20T22:32:30.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24682024-12-20T22:32:30.983ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24692024-12-20T22:32:30.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24702024-12-20T22:32:30.985ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24712024-12-20T22:32:30.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24722024-12-20T22:32:30.993ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 420.099123ms iteration = 14 status = {}
24732024-12-20T22:32:31.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a9ae7a4e-393e-4658-9f97-5ecce82a845d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24742024-12-20T22:32:31.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a9ae7a4e-393e-4658-9f97-5ecce82a845d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24752024-12-20T22:32:31.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a9ae7a4e-393e-4658-9f97-5ecce82a845d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24762024-12-20T22:32:32.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 80723633-ad90-4fc1-b776-5a07e91d8537 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24772024-12-20T22:32:32.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 80723633-ad90-4fc1-b776-5a07e91d8537 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24782024-12-20T22:32:32.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 80723633-ad90-4fc1-b776-5a07e91d8537 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24792024-12-20T22:32:33.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6a1fff1a-d960-4bcb-afd6-9ebf5341a46e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24802024-12-20T22:32:33.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6a1fff1a-d960-4bcb-afd6-9ebf5341a46e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24812024-12-20T22:32:33.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6a1fff1a-d960-4bcb-afd6-9ebf5341a46e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24822024-12-20T22:32:34.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 17426567-c69b-45fd-9aff-bb7dfca93234 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24832024-12-20T22:32:34.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 17426567-c69b-45fd-9aff-bb7dfca93234 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24842024-12-20T22:32:34.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 17426567-c69b-45fd-9aff-bb7dfca93234 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24852024-12-20T22:32:35.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 616 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 20d9b767-08d7-4a43-b00c-177426fb88bc response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
24862024-12-20T22:32:35.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 793772fe-476e-4ef8-b516-250bf4f54647 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24872024-12-20T22:32:35.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 793772fe-476e-4ef8-b516-250bf4f54647 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24882024-12-20T22:32:35.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2150 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 793772fe-476e-4ef8-b516-250bf4f54647 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24892024-12-20T22:32:36.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c7626b7c-3702-4760-baa1-95753e32d6ac roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24902024-12-20T22:32:36.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c7626b7c-3702-4760-baa1-95753e32d6ac resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24912024-12-20T22:32:36.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1643 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c7626b7c-3702-4760-baa1-95753e32d6ac response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24922024-12-20T22:32:37.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 26d78f86-d822-488a-8466-0ac471def7a0 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24932024-12-20T22:32:37.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 26d78f86-d822-488a-8466-0ac471def7a0 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24942024-12-20T22:32:37.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2280 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 26d78f86-d822-488a-8466-0ac471def7a0 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24952024-12-20T22:32:38.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 53513cad-a01b-4ce7-a9b3-16bd7c6c67a3 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24962024-12-20T22:32:38.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 53513cad-a01b-4ce7-a9b3-16bd7c6c67a3 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24972024-12-20T22:32:38.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 53513cad-a01b-4ce7-a9b3-16bd7c6c67a3 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24982024-12-20T22:32:39.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3ca6e2ea-d952-4074-879a-711b5bb76ca3 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
24992024-12-20T22:32:39.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3ca6e2ea-d952-4074-879a-711b5bb76ca3 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25002024-12-20T22:32:39.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3ca6e2ea-d952-4074-879a-711b5bb76ca3 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25012024-12-20T22:32:40.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
25022024-12-20T22:32:40.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25032024-12-20T22:32:40.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25042024-12-20T22:32:40.572ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
25052024-12-20T22:32:40.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25062024-12-20T22:32:40.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25072024-12-20T22:32:40.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25082024-12-20T22:32:40.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25092024-12-20T22:32:40.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25102024-12-20T22:32:40.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.025521ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25112024-12-20T22:32:40.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25122024-12-20T22:32:40.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25132024-12-20T22:32:40.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25142024-12-20T22:32:40.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25152024-12-20T22:32:40.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25162024-12-20T22:32:40.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25172024-12-20T22:32:40.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
25182024-12-20T22:32:40.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25192024-12-20T22:32:40.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25202024-12-20T22:32:40.594ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
25212024-12-20T22:32:40.594ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.351997ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
25222024-12-20T22:32:40.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2f87e9d7-9710-4e8b-93ac-33dcb12c9633 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25232024-12-20T22:32:40.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2f87e9d7-9710-4e8b-93ac-33dcb12c9633 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25242024-12-20T22:32:40.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1795 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2f87e9d7-9710-4e8b-93ac-33dcb12c9633 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25252024-12-20T22:32:41.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4e76cbd2-be7b-4c68-9d12-0aa8f1448b6e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25262024-12-20T22:32:41.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4e76cbd2-be7b-4c68-9d12-0aa8f1448b6e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25272024-12-20T22:32:41.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4e76cbd2-be7b-4c68-9d12-0aa8f1448b6e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25282024-12-20T22:32:42.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7eb63dbc-31c0-42fb-bfd5-68ab78116d87 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25292024-12-20T22:32:42.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7eb63dbc-31c0-42fb-bfd5-68ab78116d87 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25302024-12-20T22:32:42.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2700 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7eb63dbc-31c0-42fb-bfd5-68ab78116d87 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25312024-12-20T22:32:43.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 65b4fadc-09c6-4e81-845a-866403de59c9 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25322024-12-20T22:32:43.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 65b4fadc-09c6-4e81-845a-866403de59c9 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25332024-12-20T22:32:43.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 65b4fadc-09c6-4e81-845a-866403de59c9 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25342024-12-20T22:32:44.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 77577a21-9991-4fb5-880f-e27a29228fb3 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25352024-12-20T22:32:44.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 77577a21-9991-4fb5-880f-e27a29228fb3 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25362024-12-20T22:32:44.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2795 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 77577a21-9991-4fb5-880f-e27a29228fb3 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25372024-12-20T22:32:45.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 502 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 84ccec42-7c03-4bc5-9f65-257482dd8457 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
25382024-12-20T22:32:45.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c84e1011-0b1e-4dc9-97cd-257a5faa98eb roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25392024-12-20T22:32:45.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c84e1011-0b1e-4dc9-97cd-257a5faa98eb resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25402024-12-20T22:32:45.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c84e1011-0b1e-4dc9-97cd-257a5faa98eb response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25412024-12-20T22:32:46.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0d0b1767-7bb8-4b8f-bc12-8b588d854404 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25422024-12-20T22:32:46.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0d0b1767-7bb8-4b8f-bc12-8b588d854404 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25432024-12-20T22:32:46.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1933 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0d0b1767-7bb8-4b8f-bc12-8b588d854404 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25442024-12-20T22:32:47.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 86650e97-c8ce-463c-9108-de13cfc1577b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25452024-12-20T22:32:47.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 86650e97-c8ce-463c-9108-de13cfc1577b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25462024-12-20T22:32:47.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 86650e97-c8ce-463c-9108-de13cfc1577b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25472024-12-20T22:32:48.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5e4924da-ce1d-4f0b-9fd6-7432919f8f08 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25482024-12-20T22:32:48.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5e4924da-ce1d-4f0b-9fd6-7432919f8f08 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25492024-12-20T22:32:48.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5e4924da-ce1d-4f0b-9fd6-7432919f8f08 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25502024-12-20T22:32:50.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a85aa680-bc9f-4be3-9641-7b53c3a1d87f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25512024-12-20T22:32:50.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a85aa680-bc9f-4be3-9641-7b53c3a1d87f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25522024-12-20T22:32:50.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a85aa680-bc9f-4be3-9641-7b53c3a1d87f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25532024-12-20T22:32:50.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 1b5b72a3-deaa-4de1-9f72-d89376313ad5 roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
25542024-12-20T22:32:50.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 1b5b72a3-deaa-4de1-9f72-d89376313ad5 resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
25552024-12-20T22:32:50.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 1b5b72a3-deaa-4de1-9f72-d89376313ad5 response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
25562024-12-20T22:32:50.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 42e974d1-b5ba-484d-8ea3-609ce1bb29a4 roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
25572024-12-20T22:32:50.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 42e974d1-b5ba-484d-8ea3-609ce1bb29a4 resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
25582024-12-20T22:32:50.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49427 req_id = 42e974d1-b5ba-484d-8ea3-609ce1bb29a4 response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
25592024-12-20T22:32:50.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
25602024-12-20T22:32:50.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25612024-12-20T22:32:50.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25622024-12-20T22:32:50.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
25632024-12-20T22:32:50.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25642024-12-20T22:32:50.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25652024-12-20T22:32:50.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25662024-12-20T22:32:50.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25672024-12-20T22:32:50.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25682024-12-20T22:32:50.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25692024-12-20T22:32:50.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25702024-12-20T22:32:50.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25712024-12-20T22:32:50.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25722024-12-20T22:32:50.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
25732024-12-20T22:32:50.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25742024-12-20T22:32:50.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25752024-12-20T22:32:50.592ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
25762024-12-20T22:32:50.592ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.100735ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
25772024-12-20T22:32:50.610ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25782024-12-20T22:32:50.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25792024-12-20T22:32:50.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.362926ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25802024-12-20T22:32:51.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a1c5cc20-e994-4ff8-89af-93522f117bcd roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25812024-12-20T22:32:51.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a1c5cc20-e994-4ff8-89af-93522f117bcd resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25822024-12-20T22:32:51.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a1c5cc20-e994-4ff8-89af-93522f117bcd response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25832024-12-20T22:32:52.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0c4dc767-3364-4b1f-a112-9e26d3a8e38f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25842024-12-20T22:32:52.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0c4dc767-3364-4b1f-a112-9e26d3a8e38f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25852024-12-20T22:32:52.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1882 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0c4dc767-3364-4b1f-a112-9e26d3a8e38f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25862024-12-20T22:32:53.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7ab2ea40-a770-4f63-88e9-bfd100c59afa roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25872024-12-20T22:32:53.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7ab2ea40-a770-4f63-88e9-bfd100c59afa resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25882024-12-20T22:32:53.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7ab2ea40-a770-4f63-88e9-bfd100c59afa response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25892024-12-20T22:32:54.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1ca753ed-7256-43c8-b3dd-ee565e505f88 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25902024-12-20T22:32:54.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1ca753ed-7256-43c8-b3dd-ee565e505f88 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25912024-12-20T22:32:54.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1ca753ed-7256-43c8-b3dd-ee565e505f88 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25922024-12-20T22:32:55.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 21441d78-ea11-462e-979a-5cf3c2702687 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25932024-12-20T22:32:55.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 21441d78-ea11-462e-979a-5cf3c2702687 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25942024-12-20T22:32:55.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 21441d78-ea11-462e-979a-5cf3c2702687 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25952024-12-20T22:32:55.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 558 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = c694202e-a6f9-4b64-96fa-1be8352b20ce response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
25962024-12-20T22:32:56.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d1741326-9873-4beb-ac7d-a61265e60cc9 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25972024-12-20T22:32:56.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d1741326-9873-4beb-ac7d-a61265e60cc9 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25982024-12-20T22:32:56.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2512 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d1741326-9873-4beb-ac7d-a61265e60cc9 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
25992024-12-20T22:32:57.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ff71347f-1fda-4177-8103-9437d90a1671 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
26002024-12-20T22:32:57.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ff71347f-1fda-4177-8103-9437d90a1671 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
26012024-12-20T22:32:57.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ff71347f-1fda-4177-8103-9437d90a1671 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
26022024-12-20T22:32:58.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f59bbf93-aa95-4078-b6eb-33d82912a0cb roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
26032024-12-20T22:32:58.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f59bbf93-aa95-4078-b6eb-33d82912a0cb resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
26042024-12-20T22:32:58.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f59bbf93-aa95-4078-b6eb-33d82912a0cb response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
26052024-12-20T22:32:59.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5719f074-71ca-46ce-bab4-572ba0d598aa roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
26062024-12-20T22:32:59.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5719f074-71ca-46ce-bab4-572ba0d598aa resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
26072024-12-20T22:32:59.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2681 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5719f074-71ca-46ce-bab4-572ba0d598aa response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
26082024-12-20T22:33:00.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0dbb6a67-2c06-4899-b90c-da5a69bd3258 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
26092024-12-20T22:33:00.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0dbb6a67-2c06-4899-b90c-da5a69bd3258 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
26102024-12-20T22:33:00.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3016 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0dbb6a67-2c06-4899-b90c-da5a69bd3258 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
26112024-12-20T22:33:00.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 501022eb-304a-40a6-832d-9f7c26268b3f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
26122024-12-20T22:33:00.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 501022eb-304a-40a6-832d-9f7c26268b3f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
26132024-12-20T22:33:00.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3576 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 501022eb-304a-40a6-832d-9f7c26268b3f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
26142024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
26152024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
26162024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
26172024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26182024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
26192024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
26202024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
26212024-12-20T22:33:00.571ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:23:00.571336515 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
26222024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
26232024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
26242024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
26252024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
26262024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26272024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
26282024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
26292024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
26302024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
26312024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26322024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
26332024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26342024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
26352024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
26362024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26372024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26382024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26392024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26402024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
26412024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
26422024-12-20T22:33:00.571ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e
26432024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26442024-12-20T22:33:00.571ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 8.82\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e"}
26452024-12-20T22:33:00.571ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bcf7579-f08c-458a-b8fa-486beafab77e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c65750e1-e505-4d05-b242-145c69974016.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c65750e1-e505-4d05-b242-145c69974016.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1128, tv_nsec: 184529064 } })
26462024-12-20T22:33:00.571ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b172144-6fe3-403a-b88e-6be93db6788c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e1e925bb-4266-49d2-b532-0f79860badbb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9d7e78a-d944-4f23-9be0-86e0f1334a43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9d7e78a-d944-4f23-9be0-86e0f1334a43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1128, tv_nsec: 184537904 } })
26472024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26482024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
26492024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 988.897\u{b5}s iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
26502024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
26512024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.143731ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
26522024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
26532024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26542024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
26552024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26562024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
26572024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
26582024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
26592024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26602024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
26612024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26622024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
26632024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26642024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26652024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
26662024-12-20T22:33:00.572ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
26672024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26682024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
26692024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
26702024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
26712024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26722024-12-20T22:33:00.572ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
26732024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26742024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
26752024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
26762024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
26772024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
26782024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
26792024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
26802024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
26812024-12-20T22:33:00.573ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
26822024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
26832024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
26842024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
26852024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
26862024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26872024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
26882024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26892024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26902024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26912024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26922024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26932024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26942024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26952024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26962024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
26972024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
26982024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26992024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
27002024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
27012024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
27022024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
27032024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27042024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27052024-12-20T22:33:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27062024-12-20T22:33:00.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1128, tv_nsec: 187259180 } })
27072024-12-20T22:33:00.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27082024-12-20T22:33:00.574ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27092024-12-20T22:33:00.575ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
27102024-12-20T22:33:00.575ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:23:00.571336515 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
27112024-12-20T22:33:00.575ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.769084ms iteration = 8 status = {"expiration":"2024-12-20T22:23:00.571336515Z","pruned":[]}
27122024-12-20T22:33:00.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27132024-12-20T22:33:00.575ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1128, tv_nsec: 187870947 } })
27142024-12-20T22:33:00.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27152024-12-20T22:33:00.575ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
27162024-12-20T22:33:00.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27172024-12-20T22:33:00.575ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.242827ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
27182024-12-20T22:33:00.577ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
27192024-12-20T22:33:00.577ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27202024-12-20T22:33:00.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27212024-12-20T22:33:00.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27222024-12-20T22:33:00.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27232024-12-20T22:33:00.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27242024-12-20T22:33:00.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27252024-12-20T22:33:00.579ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27262024-12-20T22:33:00.579ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
27272024-12-20T22:33:00.579ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27282024-12-20T22:33:00.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27292024-12-20T22:33:00.579ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27302024-12-20T22:33:00.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27312024-12-20T22:33:00.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27322024-12-20T22:33:00.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27332024-12-20T22:33:00.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27342024-12-20T22:33:00.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27352024-12-20T22:33:00.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27362024-12-20T22:33:00.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27372024-12-20T22:33:00.582ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27382024-12-20T22:33:00.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27392024-12-20T22:33:00.582ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27402024-12-20T22:33:00.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27412024-12-20T22:33:00.584ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
27422024-12-20T22:33:00.584ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
27432024-12-20T22:33:00.584ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 11.321653ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
27442024-12-20T22:33:00.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27452024-12-20T22:33:00.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27462024-12-20T22:33:00.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27472024-12-20T22:33:00.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
27482024-12-20T22:33:00.585ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27492024-12-20T22:33:00.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27502024-12-20T22:33:00.587ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.948093ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
27512024-12-20T22:33:00.588ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27522024-12-20T22:33:00.589ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.705321ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
27532024-12-20T22:33:00.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
27542024-12-20T22:33:00.590ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
27552024-12-20T22:33:00.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
27562024-12-20T22:33:00.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27572024-12-20T22:33:00.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27582024-12-20T22:33:00.594ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 21.75404ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27592024-12-20T22:33:00.594ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27602024-12-20T22:33:00.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27612024-12-20T22:33:00.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
27622024-12-20T22:33:00.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
27632024-12-20T22:33:00.602ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
27642024-12-20T22:33:00.605ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
27652024-12-20T22:33:00.605ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
27662024-12-20T22:33:00.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27672024-12-20T22:33:00.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27682024-12-20T22:33:00.606ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27692024-12-20T22:33:00.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27702024-12-20T22:33:00.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27712024-12-20T22:33:00.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27722024-12-20T22:33:00.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27732024-12-20T22:33:00.608ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27742024-12-20T22:33:00.608ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27752024-12-20T22:33:00.608ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27762024-12-20T22:33:00.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27772024-12-20T22:33:00.608ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1128, tv_nsec: 221409392 } })
27782024-12-20T22:33:00.609ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
27792024-12-20T22:33:00.611ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
27802024-12-20T22:33:00.611ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
27812024-12-20T22:33:00.611ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 38.854492ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
27822024-12-20T22:33:00.612ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
27832024-12-20T22:33:00.612ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 39.783738ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
27842024-12-20T22:33:00.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
27852024-12-20T22:33:00.613ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27862024-12-20T22:33:00.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27872024-12-20T22:33:00.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27882024-12-20T22:33:00.618ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27892024-12-20T22:33:00.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27902024-12-20T22:33:00.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
27912024-12-20T22:33:00.621ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27922024-12-20T22:33:00.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27932024-12-20T22:33:00.642ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27942024-12-20T22:33:00.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27952024-12-20T22:33:00.645ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27962024-12-20T22:33:00.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27972024-12-20T22:33:00.652ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 79.68984ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
27982024-12-20T22:33:00.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27992024-12-20T22:33:00.654ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28002024-12-20T22:33:00.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28012024-12-20T22:33:00.656ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
28022024-12-20T22:33:00.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28032024-12-20T22:33:00.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28042024-12-20T22:33:00.657ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
28052024-12-20T22:33:00.657ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
28062024-12-20T22:33:00.657ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
28072024-12-20T22:33:00.657ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28082024-12-20T22:33:00.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28092024-12-20T22:33:00.661ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28102024-12-20T22:33:00.662ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28112024-12-20T22:33:00.662ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
28122024-12-20T22:33:00.662ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28132024-12-20T22:33:00.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28142024-12-20T22:33:00.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28152024-12-20T22:33:00.664ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28162024-12-20T22:33:00.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28172024-12-20T22:33:00.668ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28182024-12-20T22:33:00.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
28192024-12-20T22:33:00.671ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28202024-12-20T22:33:00.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28212024-12-20T22:33:00.672ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28222024-12-20T22:33:00.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28232024-12-20T22:33:00.700ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
28242024-12-20T22:33:00.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
28252024-12-20T22:33:00.725ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
28262024-12-20T22:33:00.725ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28272024-12-20T22:33:00.726ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "67cf59bd-674b-41a1-b213-f7d7670aff9b", "content-length": "26", "date": "Fri, 20 Dec 2024 22:33:00 GMT"} })
28282024-12-20T22:33:00.726ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28292024-12-20T22:33:00.729ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28302024-12-20T22:33:00.732ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
28312024-12-20T22:33:00.740ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
28322024-12-20T22:33:00.802ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
28332024-12-20T22:33:00.802ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28342024-12-20T22:33:00.803ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "045f6b90-3374-4889-93b3-531354cc2a6c", "content-length": "372", "date": "Fri, 20 Dec 2024 22:33:00 GMT"} })
28352024-12-20T22:33:00.803ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28362024-12-20T22:33:00.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28372024-12-20T22:33:00.804ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28382024-12-20T22:33:00.806ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
28392024-12-20T22:33:00.806ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28402024-12-20T22:33:00.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28412024-12-20T22:33:00.808ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 236.033613ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28422024-12-20T22:33:00.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28432024-12-20T22:33:00.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28442024-12-20T22:33:00.817ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
28452024-12-20T22:33:00.817ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 246.120372ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
28462024-12-20T22:33:00.851ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
28472024-12-20T22:33:00.851ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28482024-12-20T22:33:00.851ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "30484359-0dc8-42d8-aa93-061af21fb824", "content-length": "26", "date": "Fri, 20 Dec 2024 22:33:00 GMT"} })
28492024-12-20T22:33:00.851ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28502024-12-20T22:33:00.853ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28512024-12-20T22:33:00.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28522024-12-20T22:33:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28532024-12-20T22:33:00.858ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28542024-12-20T22:33:00.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28552024-12-20T22:33:00.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28562024-12-20T22:33:00.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
28572024-12-20T22:33:00.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28582024-12-20T22:33:00.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28592024-12-20T22:33:00.866ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 293.51608ms iteration = 15 status = 0
28602024-12-20T22:33:00.866ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28612024-12-20T22:33:00.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28622024-12-20T22:33:00.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 294.325542ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28632024-12-20T22:33:00.868ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28642024-12-20T22:33:00.868ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
28652024-12-20T22:33:00.868ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 295.67926ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
28662024-12-20T22:33:00.870ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
28672024-12-20T22:33:00.870ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
28682024-12-20T22:33:00.870ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28692024-12-20T22:33:00.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28702024-12-20T22:33:00.871ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28712024-12-20T22:33:00.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28722024-12-20T22:33:00.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
28732024-12-20T22:33:00.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28742024-12-20T22:33:00.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
28752024-12-20T22:33:00.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28762024-12-20T22:33:00.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28772024-12-20T22:33:00.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28782024-12-20T22:33:00.883ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
28792024-12-20T22:33:00.884ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
28802024-12-20T22:33:00.884ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:26:39.700273 UTC dns_group = internal generation = 1
28812024-12-20T22:33:00.884ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 312.604967ms iteration = 8 status = {"generation":1}
28822024-12-20T22:33:00.884ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 zone_address = fd00:1122:3344:101::2
28832024-12-20T22:33:00.884ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28842024-12-20T22:33:00.884ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "62fa713b-d5f4-45cb-8925-cfe3f1ffca18", "content-length": "26", "date": "Fri, 20 Dec 2024 22:33:00 GMT"} })
28852024-12-20T22:33:00.884ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28862024-12-20T22:33:00.886ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
28872024-12-20T22:33:00.893ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
28882024-12-20T22:33:00.893ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
28892024-12-20T22:33:00.893ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a724877d-eaac-4830-b47f-01ec0ed8d3cf", "date": "Fri, 20 Dec 2024 22:33:00 GMT"} })
28902024-12-20T22:33:00.893ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28912024-12-20T22:33:00.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28922024-12-20T22:33:00.896ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28932024-12-20T22:33:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28942024-12-20T22:33:00.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28952024-12-20T22:33:00.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28962024-12-20T22:33:00.901ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:25:57.040586Z, time_modified: 2024-12-20T22:25:57.040586Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }) }
28972024-12-20T22:33:00.901ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 329.893793ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]}},"default_endpoint":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
28982024-12-20T22:33:00.905ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
28992024-12-20T22:33:00.905ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29002024-12-20T22:33:00.905ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "719ffa60-a9ea-47a1-baf2-c5c786054376", "date": "Fri, 20 Dec 2024 22:33:00 GMT"} })
29012024-12-20T22:33:00.906ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 334.034348ms iteration = 15 status = {}
29022024-12-20T22:33:00.919ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
29032024-12-20T22:33:00.919ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 346.43342ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
29042024-12-20T22:33:00.928ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
29052024-12-20T22:33:00.929ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 0 version = 2
29062024-12-20T22:33:00.929ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29072024-12-20T22:33:00.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29082024-12-20T22:33:00.930ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29092024-12-20T22:33:00.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
29102024-12-20T22:33:00.934ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29112024-12-20T22:33:00.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29122024-12-20T22:33:00.936ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 1 version = 2
29132024-12-20T22:33:00.936ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
29142024-12-20T22:33:00.936ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:26:40.428768 UTC dns_group = external generation = 2
29152024-12-20T22:33:00.936ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 364.784796ms iteration = 8 status = {"generation":2}
29162024-12-20T22:33:00.976ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29172024-12-20T22:33:00.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29182024-12-20T22:33:00.991ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 418.250903ms iteration = 17 status = {"physical_disks_added":0}
29192024-12-20T22:33:00.993ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
29202024-12-20T22:33:00.993ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 420.179706ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
29212024-12-20T22:33:01.018ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29222024-12-20T22:33:01.020ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29232024-12-20T22:33:01.020ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29242024-12-20T22:33:01.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29252024-12-20T22:33:01.024ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
29262024-12-20T22:33:01.024ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
29272024-12-20T22:33:01.024ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d9b7428-0535-4727-ab10-087022a605b4", "content-length": "1", "date": "Fri, 20 Dec 2024 22:33:00 GMT"} })
29282024-12-20T22:33:01.024ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "75f880b0-3f3f-44c4-9b9d-dbd807bfa044", "date": "Fri, 20 Dec 2024 22:33:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29292024-12-20T22:33:01.024ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29302024-12-20T22:33:01.027ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29312024-12-20T22:33:01.027ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "78e195ee-8093-459d-811a-aea46b0719c2", "date": "Fri, 20 Dec 2024 22:33:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29322024-12-20T22:33:01.027ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29332024-12-20T22:33:01.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29342024-12-20T22:33:01.029ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29352024-12-20T22:33:01.029ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 457.938978ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
29362024-12-20T22:33:01.029ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 458.310718ms iteration = 15 status = null
29372024-12-20T22:33:01.034ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 463.026458ms iteration = 15 status = {}
29382024-12-20T22:33:01.043ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
29392024-12-20T22:33:01.044ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "0b1deca1-dae8-4018-85e8-6f7dd836f15d", "date": "Fri, 20 Dec 2024 22:33:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
29402024-12-20T22:33:01.044ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
29412024-12-20T22:33:01.045ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a3bdb240-90e2-4b6b-b279-9999b0dfbdee", "date": "Fri, 20 Dec 2024 22:33:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
29422024-12-20T22:33:01.045ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
29432024-12-20T22:33:01.047ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b79e4fa4-39b3-4d36-a237-a81fc9a029e0", "date": "Fri, 20 Dec 2024 22:33:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
29442024-12-20T22:33:01.047ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
29452024-12-20T22:33:01.049ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
29462024-12-20T22:33:01.050ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 478.691661ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
29472024-12-20T22:33:01.067ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29482024-12-20T22:33:01.069ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29492024-12-20T22:33:01.069ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29502024-12-20T22:33:01.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29512024-12-20T22:33:01.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29522024-12-20T22:33:01.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29532024-12-20T22:33:01.111ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9fedf0d4-8a86-4506-bf93-224faabd5e37, rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b26f0563-25fb-4d7c-8480-dd368ac01105) } rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
29542024-12-20T22:33:01.111ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29552024-12-20T22:33:01.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29562024-12-20T22:33:01.127ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
29572024-12-20T22:33:01.127ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8022900b-88f5-4150-9dc2-15d3d480ff5e", "content-length": "134", "date": "Fri, 20 Dec 2024 22:33:00 GMT"} })
29582024-12-20T22:33:01.127ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
29592024-12-20T22:33:01.127ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b26f0563-25fb-4d7c-8480-dd368ac01105
29602024-12-20T22:33:01.128ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
29612024-12-20T22:33:01.128ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29622024-12-20T22:33:01.128ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29632024-12-20T22:33:01.128ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29642024-12-20T22:33:01.128ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29652024-12-20T22:33:01.128ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29662024-12-20T22:33:01.128ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29672024-12-20T22:33:01.128ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29682024-12-20T22:33:01.128ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
29692024-12-20T22:33:01.128ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29702024-12-20T22:33:01.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29712024-12-20T22:33:01.131ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
29722024-12-20T22:33:01.131ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac19cd4d-e917-420e-ad15-046eaf86bcf6", "content-length": "2", "date": "Fri, 20 Dec 2024 22:33:00 GMT"} })
29732024-12-20T22:33:01.131ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
29742024-12-20T22:33:01.131ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f90b7fc7-d93d-4d18-a736-4a65fb731fb2", "content-length": "52", "date": "Fri, 20 Dec 2024 22:33:00 GMT"} })
29752024-12-20T22:33:01.131ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
29762024-12-20T22:33:01.131ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
29772024-12-20T22:33:01.194ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
29782024-12-20T22:33:01.230ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5b6f717e-802e-41d9-9226-4f0731d9ac81", "date": "Fri, 20 Dec 2024 22:33:01 GMT"} })
29792024-12-20T22:33:01.230ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch = Switch0
29802024-12-20T22:33:01.230ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
29812024-12-20T22:33:01.231ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4ad61c2-1fd2-4c7e-af9c-ab30f91a6fbf", "content-length": "691", "date": "Fri, 20 Dec 2024 22:33:01 GMT"} })
29822024-12-20T22:33:01.231ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
29832024-12-20T22:33:01.231ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
29842024-12-20T22:33:01.231ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
29852024-12-20T22:33:01.231ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "feeae6e4-93b0-4ae4-a5b9-c1444bae37ff", "content-length": "682", "date": "Fri, 20 Dec 2024 22:33:01 GMT"} })
29862024-12-20T22:33:01.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29872024-12-20T22:33:01.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29882024-12-20T22:33:01.233ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 660.448726ms iteration = 15 status = {}
29892024-12-20T22:33:01.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29902024-12-20T22:33:01.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29912024-12-20T22:33:01.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29922024-12-20T22:33:01.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29932024-12-20T22:33:01.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29942024-12-20T22:33:01.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29952024-12-20T22:33:01.247ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 675.029648ms iteration = 15 status = {}
29962024-12-20T22:33:01.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 88e2293f-12a4-49ad-a219-1c960a8b909d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
29972024-12-20T22:33:01.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 88e2293f-12a4-49ad-a219-1c960a8b909d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
29982024-12-20T22:33:01.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 88e2293f-12a4-49ad-a219-1c960a8b909d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
29992024-12-20T22:33:02.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 61de9612-bd5a-4397-b01b-b4323bb22139 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30002024-12-20T22:33:02.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 61de9612-bd5a-4397-b01b-b4323bb22139 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30012024-12-20T22:33:02.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 61de9612-bd5a-4397-b01b-b4323bb22139 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30022024-12-20T22:33:03.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 659389eb-5b23-4956-8a3a-d7cf6355d01b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30032024-12-20T22:33:03.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 659389eb-5b23-4956-8a3a-d7cf6355d01b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30042024-12-20T22:33:03.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 659389eb-5b23-4956-8a3a-d7cf6355d01b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30052024-12-20T22:33:04.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 09ced2d5-0601-4ebe-8003-93572bfa16b7 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30062024-12-20T22:33:04.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 09ced2d5-0601-4ebe-8003-93572bfa16b7 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30072024-12-20T22:33:04.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 09ced2d5-0601-4ebe-8003-93572bfa16b7 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30082024-12-20T22:33:05.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 518 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = eccbd6f3-9362-42ff-bdac-62a73ecc9259 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
30092024-12-20T22:33:05.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = af76c2d0-4d2f-4b99-bccf-c702e70c57ff roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30102024-12-20T22:33:05.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = af76c2d0-4d2f-4b99-bccf-c702e70c57ff resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30112024-12-20T22:33:05.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = af76c2d0-4d2f-4b99-bccf-c702e70c57ff response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30122024-12-20T22:33:06.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f2640696-a9c1-43da-a0c2-a8c77cfe3a40 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30132024-12-20T22:33:06.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f2640696-a9c1-43da-a0c2-a8c77cfe3a40 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30142024-12-20T22:33:06.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f2640696-a9c1-43da-a0c2-a8c77cfe3a40 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30152024-12-20T22:33:07.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 22fea999-b5c9-42f3-898b-a1e5d93812ec roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30162024-12-20T22:33:07.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 22fea999-b5c9-42f3-898b-a1e5d93812ec resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30172024-12-20T22:33:07.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 22fea999-b5c9-42f3-898b-a1e5d93812ec response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30182024-12-20T22:33:08.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1a174699-0150-4b12-b476-f72ce15a78fe roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30192024-12-20T22:33:08.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1a174699-0150-4b12-b476-f72ce15a78fe resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30202024-12-20T22:33:08.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1a174699-0150-4b12-b476-f72ce15a78fe response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30212024-12-20T22:33:09.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 726ebf3f-1b5d-41ad-a800-87161036b355 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30222024-12-20T22:33:09.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 726ebf3f-1b5d-41ad-a800-87161036b355 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30232024-12-20T22:33:09.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 726ebf3f-1b5d-41ad-a800-87161036b355 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30242024-12-20T22:33:10.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6358b6eb-abee-41ef-a57e-843e1082aee9 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30252024-12-20T22:33:10.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6358b6eb-abee-41ef-a57e-843e1082aee9 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30262024-12-20T22:33:10.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1828 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6358b6eb-abee-41ef-a57e-843e1082aee9 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30272024-12-20T22:33:10.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
30282024-12-20T22:33:10.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30292024-12-20T22:33:10.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30302024-12-20T22:33:10.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
30312024-12-20T22:33:10.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30322024-12-20T22:33:10.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30332024-12-20T22:33:10.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30342024-12-20T22:33:10.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30352024-12-20T22:33:10.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30362024-12-20T22:33:10.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30372024-12-20T22:33:10.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30382024-12-20T22:33:10.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30392024-12-20T22:33:10.614ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30402024-12-20T22:33:10.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30412024-12-20T22:33:10.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30422024-12-20T22:33:10.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
30432024-12-20T22:33:10.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30442024-12-20T22:33:10.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30452024-12-20T22:33:10.633ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
30462024-12-20T22:33:10.633ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 61.734264ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
30472024-12-20T22:33:10.662ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 88.891743ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30482024-12-20T22:33:11.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 29f70437-13f2-42a6-ba34-ab79750ffdda roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30492024-12-20T22:33:11.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 29f70437-13f2-42a6-ba34-ab79750ffdda resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30502024-12-20T22:33:11.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 29f70437-13f2-42a6-ba34-ab79750ffdda response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30512024-12-20T22:33:12.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7bb553bb-b338-4b66-a33a-f4c49bc7863b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30522024-12-20T22:33:12.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7bb553bb-b338-4b66-a33a-f4c49bc7863b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30532024-12-20T22:33:12.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7bb553bb-b338-4b66-a33a-f4c49bc7863b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30542024-12-20T22:33:13.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 091b7c23-67e8-4db3-ac5a-59766f651916 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30552024-12-20T22:33:13.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 091b7c23-67e8-4db3-ac5a-59766f651916 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30562024-12-20T22:33:13.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 091b7c23-67e8-4db3-ac5a-59766f651916 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30572024-12-20T22:33:14.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cd463b1c-aa0e-4d86-a766-d71dff9e5237 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30582024-12-20T22:33:14.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cd463b1c-aa0e-4d86-a766-d71dff9e5237 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30592024-12-20T22:33:14.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cd463b1c-aa0e-4d86-a766-d71dff9e5237 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30602024-12-20T22:33:15.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 544 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 7f764e85-b907-4dfb-bfe9-45391d734276 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
30612024-12-20T22:33:15.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3465263d-0295-4756-b185-1d233d134024 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30622024-12-20T22:33:15.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3465263d-0295-4756-b185-1d233d134024 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30632024-12-20T22:33:15.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3465263d-0295-4756-b185-1d233d134024 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30642024-12-20T22:33:16.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6543806a-f6a3-4422-8845-82fce08c6109 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30652024-12-20T22:33:16.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6543806a-f6a3-4422-8845-82fce08c6109 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30662024-12-20T22:33:16.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2623 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6543806a-f6a3-4422-8845-82fce08c6109 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30672024-12-20T22:33:17.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b03a9fa1-0e40-4756-a015-09c2e8f62a31 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30682024-12-20T22:33:17.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b03a9fa1-0e40-4756-a015-09c2e8f62a31 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30692024-12-20T22:33:17.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b03a9fa1-0e40-4756-a015-09c2e8f62a31 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30702024-12-20T22:33:18.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cb2fd6ab-610c-4ce9-84ef-c38633235556 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30712024-12-20T22:33:18.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cb2fd6ab-610c-4ce9-84ef-c38633235556 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30722024-12-20T22:33:18.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cb2fd6ab-610c-4ce9-84ef-c38633235556 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30732024-12-20T22:33:19.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 89d42f62-f9c1-4fe9-862a-d2a30beb4010 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30742024-12-20T22:33:19.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 89d42f62-f9c1-4fe9-862a-d2a30beb4010 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30752024-12-20T22:33:19.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 89d42f62-f9c1-4fe9-862a-d2a30beb4010 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30762024-12-20T22:33:20.571ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
30772024-12-20T22:33:20.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30782024-12-20T22:33:20.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30792024-12-20T22:33:20.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
30802024-12-20T22:33:20.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30812024-12-20T22:33:20.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30822024-12-20T22:33:20.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30832024-12-20T22:33:20.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30842024-12-20T22:33:20.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30852024-12-20T22:33:20.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30862024-12-20T22:33:20.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30872024-12-20T22:33:20.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30882024-12-20T22:33:20.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30892024-12-20T22:33:20.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30902024-12-20T22:33:20.616ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.057758ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30912024-12-20T22:33:20.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30922024-12-20T22:33:20.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
30932024-12-20T22:33:20.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30942024-12-20T22:33:20.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30952024-12-20T22:33:20.631ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
30962024-12-20T22:33:20.631ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 60.112839ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
30972024-12-20T22:33:20.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7c4af70a-eba1-45a3-9991-2a1be1af9944 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30982024-12-20T22:33:20.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7c4af70a-eba1-45a3-9991-2a1be1af9944 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
30992024-12-20T22:33:20.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7c4af70a-eba1-45a3-9991-2a1be1af9944 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31002024-12-20T22:33:21.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5962d7a8-67f8-4638-a03c-d79bfe83ca4d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31012024-12-20T22:33:21.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5962d7a8-67f8-4638-a03c-d79bfe83ca4d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31022024-12-20T22:33:21.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5962d7a8-67f8-4638-a03c-d79bfe83ca4d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31032024-12-20T22:33:22.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = dfc70059-2deb-4483-9a56-76aacef434c8 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31042024-12-20T22:33:22.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = dfc70059-2deb-4483-9a56-76aacef434c8 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31052024-12-20T22:33:22.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1925 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = dfc70059-2deb-4483-9a56-76aacef434c8 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31062024-12-20T22:33:23.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 10536954-2366-4431-b542-1e31c651cf2c roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31072024-12-20T22:33:23.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 10536954-2366-4431-b542-1e31c651cf2c resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31082024-12-20T22:33:23.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 10536954-2366-4431-b542-1e31c651cf2c response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31092024-12-20T22:33:24.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5aff58ca-e1f0-492c-85a2-c7a8c90d44bc roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31102024-12-20T22:33:24.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5aff58ca-e1f0-492c-85a2-c7a8c90d44bc resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31112024-12-20T22:33:24.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5aff58ca-e1f0-492c-85a2-c7a8c90d44bc response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31122024-12-20T22:33:25.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 507 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 492e0c6e-a0a0-4d34-9896-bf05353303da response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
31132024-12-20T22:33:25.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = de8cd2b1-ff42-4160-b7d7-56e018d830f0 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31142024-12-20T22:33:25.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = de8cd2b1-ff42-4160-b7d7-56e018d830f0 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31152024-12-20T22:33:25.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2669 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = de8cd2b1-ff42-4160-b7d7-56e018d830f0 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31162024-12-20T22:33:26.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 725950bb-5eb5-4576-9d2f-7b12f4b1f752 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31172024-12-20T22:33:26.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 725950bb-5eb5-4576-9d2f-7b12f4b1f752 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31182024-12-20T22:33:26.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 725950bb-5eb5-4576-9d2f-7b12f4b1f752 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31192024-12-20T22:33:27.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7820bf64-afa4-4692-84c9-546d374e0203 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31202024-12-20T22:33:27.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7820bf64-afa4-4692-84c9-546d374e0203 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31212024-12-20T22:33:27.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2016 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7820bf64-afa4-4692-84c9-546d374e0203 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31222024-12-20T22:33:28.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 37ab9e69-3adb-45ef-bace-b3b29dd52584 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31232024-12-20T22:33:28.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 37ab9e69-3adb-45ef-bace-b3b29dd52584 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31242024-12-20T22:33:28.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 37ab9e69-3adb-45ef-bace-b3b29dd52584 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31252024-12-20T22:33:29.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 48c0861c-6859-4621-929e-f75ec00389c6 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31262024-12-20T22:33:29.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 48c0861c-6859-4621-929e-f75ec00389c6 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31272024-12-20T22:33:29.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 48c0861c-6859-4621-929e-f75ec00389c6 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
31282024-12-20T22:33:30.571ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
31292024-12-20T22:33:30.571ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
31302024-12-20T22:33:30.571ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
31312024-12-20T22:33:30.571ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
31322024-12-20T22:33:30.571ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31332024-12-20T22:33:30.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
31342024-12-20T22:33:30.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31352024-12-20T22:33:30.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
31362024-12-20T22:33:30.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31372024-12-20T22:33:30.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31382024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
31392024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
31402024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
31412024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
31422024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
31432024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
31442024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31452024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31462024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
31472024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
31482024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31492024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
31502024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31512024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
31522024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
31532024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31542024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31552024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
31562024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31572024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
31582024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
31592024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31602024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31612024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
31622024-12-20T22:33:30.573ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
31632024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31642024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
31652024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31662024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
31672024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31682024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
31692024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31702024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31712024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31722024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31732024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31742024-12-20T22:33:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31752024-12-20T22:33:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31762024-12-20T22:33:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31772024-12-20T22:33:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31782024-12-20T22:33:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31792024-12-20T22:33:30.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1158, tv_nsec: 186697114 } })
31802024-12-20T22:33:30.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
31812024-12-20T22:33:30.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31822024-12-20T22:33:30.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1158, tv_nsec: 187175068 } })
31832024-12-20T22:33:30.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
31842024-12-20T22:33:30.574ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.62729ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
31852024-12-20T22:33:30.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31862024-12-20T22:33:30.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31872024-12-20T22:33:30.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31882024-12-20T22:33:30.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31892024-12-20T22:33:30.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31902024-12-20T22:33:30.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 8d4b4d14-6d66-48d1-90d3-025a3b0be851 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
31912024-12-20T22:33:30.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 8d4b4d14-6d66-48d1-90d3-025a3b0be851 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
31922024-12-20T22:33:30.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 8d4b4d14-6d66-48d1-90d3-025a3b0be851 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
31932024-12-20T22:33:30.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31942024-12-20T22:33:30.639ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31952024-12-20T22:33:30.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31962024-12-20T22:33:30.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
31972024-12-20T22:33:30.641ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31982024-12-20T22:33:30.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31992024-12-20T22:33:30.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 68.302796ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
32002024-12-20T22:33:30.641ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32012024-12-20T22:33:30.644ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32022024-12-20T22:33:30.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
32032024-12-20T22:33:30.645ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32042024-12-20T22:33:30.645ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32052024-12-20T22:33:30.645ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
32062024-12-20T22:33:30.645ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32072024-12-20T22:33:30.645ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1158, tv_nsec: 257715934 } })
32082024-12-20T22:33:30.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32092024-12-20T22:33:30.645ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32102024-12-20T22:33:30.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32112024-12-20T22:33:30.645ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
32122024-12-20T22:33:30.647ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32132024-12-20T22:33:30.647ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32142024-12-20T22:33:30.647ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32152024-12-20T22:33:30.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32162024-12-20T22:33:30.647ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32172024-12-20T22:33:30.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32182024-12-20T22:33:30.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32192024-12-20T22:33:30.648ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32202024-12-20T22:33:30.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32212024-12-20T22:33:30.649ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32222024-12-20T22:33:30.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32232024-12-20T22:33:30.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
32242024-12-20T22:33:30.652ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32252024-12-20T22:33:30.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32262024-12-20T22:33:30.652ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
32272024-12-20T22:33:30.652ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32282024-12-20T22:33:30.653ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcffc48b-5583-4d5c-b54e-ce8480b84bef", "content-length": "26", "date": "Fri, 20 Dec 2024 22:33:30 GMT"} })
32292024-12-20T22:33:30.653ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32302024-12-20T22:33:30.653ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 79.822723ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
32312024-12-20T22:33:30.653ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32322024-12-20T22:33:30.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32332024-12-20T22:33:30.654ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32342024-12-20T22:33:30.654ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32352024-12-20T22:33:30.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32362024-12-20T22:33:30.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32372024-12-20T22:33:30.655ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32382024-12-20T22:33:30.655ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 82.192358ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32392024-12-20T22:33:30.656ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32402024-12-20T22:33:30.657ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32412024-12-20T22:33:30.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32422024-12-20T22:33:30.658ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32432024-12-20T22:33:30.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32442024-12-20T22:33:30.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
32452024-12-20T22:33:30.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32462024-12-20T22:33:30.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32472024-12-20T22:33:30.668ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
32482024-12-20T22:33:30.668ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32492024-12-20T22:33:30.668ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d742f4c7-3dd4-4163-be6b-d6c2bb574d30", "content-length": "26", "date": "Fri, 20 Dec 2024 22:33:30 GMT"} })
32502024-12-20T22:33:30.668ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32512024-12-20T22:33:30.670ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32522024-12-20T22:33:30.678ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
32532024-12-20T22:33:30.678ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 106.357215ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
32542024-12-20T22:33:30.685ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32552024-12-20T22:33:30.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32562024-12-20T22:33:30.691ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32572024-12-20T22:33:30.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32582024-12-20T22:33:30.696ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 122.660785ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32592024-12-20T22:33:30.707ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32602024-12-20T22:33:30.709ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 135.612603ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32612024-12-20T22:33:30.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32622024-12-20T22:33:30.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32632024-12-20T22:33:30.709ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32642024-12-20T22:33:30.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32652024-12-20T22:33:30.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32662024-12-20T22:33:30.713ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
32672024-12-20T22:33:30.713ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 140.286322ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
32682024-12-20T22:33:30.721ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32692024-12-20T22:33:30.721ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
32702024-12-20T22:33:30.721ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32712024-12-20T22:33:30.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32722024-12-20T22:33:30.742ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32732024-12-20T22:33:30.746ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 zone_address = fd00:1122:3344:101::2
32742024-12-20T22:33:30.746ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32752024-12-20T22:33:30.746ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "509fbd69-b8a2-4cd9-a244-b8e4a4b94034", "content-length": "26", "date": "Fri, 20 Dec 2024 22:33:30 GMT"} })
32762024-12-20T22:33:30.746ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32772024-12-20T22:33:30.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
32782024-12-20T22:33:30.747ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32792024-12-20T22:33:30.747ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 173.866758ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
32802024-12-20T22:33:30.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32812024-12-20T22:33:30.748ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
32822024-12-20T22:33:30.749ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 175.544704ms iteration = 16 status = 0
32832024-12-20T22:33:30.749ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32842024-12-20T22:33:30.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32852024-12-20T22:33:30.781ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32862024-12-20T22:33:30.781ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
32872024-12-20T22:33:30.781ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 208.240307ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
32882024-12-20T22:33:30.813ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 240.276391ms iteration = 18 status = {"physical_disks_added":0}
32892024-12-20T22:33:30.821ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 250.608696ms iteration = 16 status = {}
32902024-12-20T22:33:30.836ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
32912024-12-20T22:33:30.836ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0bb2e6c-a15b-4636-a2a5-b6a3b14fe896", "content-length": "1", "date": "Fri, 20 Dec 2024 22:33:30 GMT"} })
32922024-12-20T22:33:30.838ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32932024-12-20T22:33:30.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32942024-12-20T22:33:30.840ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 269.470246ms iteration = 16 status = null
32952024-12-20T22:33:30.870ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
32962024-12-20T22:33:30.870ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32972024-12-20T22:33:30.870ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "248ffb33-341f-4eb1-a3a5-27712fdf5595", "content-length": "372", "date": "Fri, 20 Dec 2024 22:33:30 GMT"} })
32982024-12-20T22:33:30.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32992024-12-20T22:33:30.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33002024-12-20T22:33:30.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33012024-12-20T22:33:30.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33022024-12-20T22:33:30.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33032024-12-20T22:33:30.891ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33042024-12-20T22:33:30.891ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33052024-12-20T22:33:30.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33062024-12-20T22:33:30.892ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33072024-12-20T22:33:30.895ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33082024-12-20T22:33:30.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33092024-12-20T22:33:30.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33102024-12-20T22:33:30.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fb6838c6-dc96-482e-9a58-68d18747910f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33112024-12-20T22:33:30.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fb6838c6-dc96-482e-9a58-68d18747910f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33122024-12-20T22:33:30.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fb6838c6-dc96-482e-9a58-68d18747910f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33132024-12-20T22:33:30.925ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
33142024-12-20T22:33:30.925ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
33152024-12-20T22:33:30.926ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "14771567-b4c3-406a-a6c3-7f8c28cd7747", "date": "Fri, 20 Dec 2024 22:33:30 GMT"} })
33162024-12-20T22:33:30.926ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33172024-12-20T22:33:30.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33182024-12-20T22:33:30.927ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33192024-12-20T22:33:30.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33202024-12-20T22:33:30.928ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33212024-12-20T22:33:30.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33222024-12-20T22:33:30.928ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9fedf0d4-8a86-4506-bf93-224faabd5e37, rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b26f0563-25fb-4d7c-8480-dd368ac01105) } rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
33232024-12-20T22:33:30.928ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33242024-12-20T22:33:30.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33252024-12-20T22:33:30.931ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33262024-12-20T22:33:30.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33272024-12-20T22:33:30.941ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
33282024-12-20T22:33:30.942ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fd06977-4cb5-45d7-8a5c-ab1587b5cd9d", "content-length": "691", "date": "Fri, 20 Dec 2024 22:33:30 GMT"} })
33292024-12-20T22:33:30.942ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
33302024-12-20T22:33:30.942ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
33312024-12-20T22:33:30.942ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
33322024-12-20T22:33:30.944ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 371.103751ms iteration = 16 status = {}
33332024-12-20T22:33:30.945ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
33342024-12-20T22:33:30.945ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33352024-12-20T22:33:30.946ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "922f80fe-2506-4fb1-b11d-a6c09f83fc65", "date": "Fri, 20 Dec 2024 22:33:30 GMT"} })
33362024-12-20T22:33:30.948ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 374.931907ms iteration = 16 status = {}
33372024-12-20T22:33:30.951ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
33382024-12-20T22:33:30.952ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "528761b0-c32e-4d8d-866c-f37b70ecb9ee", "content-length": "134", "date": "Fri, 20 Dec 2024 22:33:30 GMT"} })
33392024-12-20T22:33:30.952ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
33402024-12-20T22:33:30.952ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b26f0563-25fb-4d7c-8480-dd368ac01105
33412024-12-20T22:33:30.952ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
33422024-12-20T22:33:30.952ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
33432024-12-20T22:33:30.952ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33442024-12-20T22:33:30.952ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33452024-12-20T22:33:30.952ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33462024-12-20T22:33:30.952ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33472024-12-20T22:33:30.952ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33482024-12-20T22:33:30.952ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33492024-12-20T22:33:30.952ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
33502024-12-20T22:33:30.952ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33512024-12-20T22:33:30.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33522024-12-20T22:33:30.954ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
33532024-12-20T22:33:30.955ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdc5ffdf-c69c-490f-9c17-f3bbe5233928", "content-length": "2", "date": "Fri, 20 Dec 2024 22:33:30 GMT"} })
33542024-12-20T22:33:30.955ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
33552024-12-20T22:33:30.955ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "09a6d485-cecc-44f5-94ae-e897b15dcc1c", "content-length": "52", "date": "Fri, 20 Dec 2024 22:33:30 GMT"} })
33562024-12-20T22:33:30.955ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
33572024-12-20T22:33:30.955ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
33582024-12-20T22:33:31.053ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "228f803f-94a1-4687-ac7b-507d4e0dcba9", "date": "Fri, 20 Dec 2024 22:33:30 GMT"} })
33592024-12-20T22:33:31.053ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch = Switch0
33602024-12-20T22:33:31.053ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
33612024-12-20T22:33:31.053ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "05eedb8f-ba82-4eba-a78f-68c67caef1d9", "content-length": "682", "date": "Fri, 20 Dec 2024 22:33:30 GMT"} })
33622024-12-20T22:33:31.053ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33632024-12-20T22:33:31.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33642024-12-20T22:33:31.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33652024-12-20T22:33:31.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33662024-12-20T22:33:31.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33672024-12-20T22:33:31.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33682024-12-20T22:33:31.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33692024-12-20T22:33:31.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33702024-12-20T22:33:31.068ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 495.162124ms iteration = 16 status = {}
33712024-12-20T22:33:31.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 971cf298-52a6-47bb-8cb2-e3ced8695567 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33722024-12-20T22:33:31.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 971cf298-52a6-47bb-8cb2-e3ced8695567 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33732024-12-20T22:33:31.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1835 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 971cf298-52a6-47bb-8cb2-e3ced8695567 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33742024-12-20T22:33:32.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 70f2ee83-33ba-4efa-bf32-eeebbaec87c0 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33752024-12-20T22:33:32.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 70f2ee83-33ba-4efa-bf32-eeebbaec87c0 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33762024-12-20T22:33:32.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 70f2ee83-33ba-4efa-bf32-eeebbaec87c0 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33772024-12-20T22:33:33.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b60bb047-db26-4808-8590-1f7e7b3b7b4d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33782024-12-20T22:33:33.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b60bb047-db26-4808-8590-1f7e7b3b7b4d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33792024-12-20T22:33:33.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b60bb047-db26-4808-8590-1f7e7b3b7b4d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33802024-12-20T22:33:34.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6a2ad387-8b70-4d62-9c00-6b27c4d07013 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33812024-12-20T22:33:34.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6a2ad387-8b70-4d62-9c00-6b27c4d07013 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33822024-12-20T22:33:34.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6a2ad387-8b70-4d62-9c00-6b27c4d07013 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33832024-12-20T22:33:35.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 541 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = b8ce4867-a62b-49b3-95f3-4930d57b6589 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
33842024-12-20T22:33:36.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 67d53bcb-5b61-44eb-9d7e-e44909f65fe5 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33852024-12-20T22:33:36.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 67d53bcb-5b61-44eb-9d7e-e44909f65fe5 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33862024-12-20T22:33:36.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1570 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 67d53bcb-5b61-44eb-9d7e-e44909f65fe5 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33872024-12-20T22:33:37.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ff48fe59-4154-4060-88d3-0159e7eea10b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33882024-12-20T22:33:37.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ff48fe59-4154-4060-88d3-0159e7eea10b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33892024-12-20T22:33:37.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ff48fe59-4154-4060-88d3-0159e7eea10b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33902024-12-20T22:33:38.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1a1e34ce-fea8-4c7d-b267-88e7ef1894a1 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33912024-12-20T22:33:38.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1a1e34ce-fea8-4c7d-b267-88e7ef1894a1 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33922024-12-20T22:33:38.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1a1e34ce-fea8-4c7d-b267-88e7ef1894a1 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33932024-12-20T22:33:39.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5eb9767e-1f69-4a47-8234-1dacac30b7b2 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33942024-12-20T22:33:39.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5eb9767e-1f69-4a47-8234-1dacac30b7b2 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33952024-12-20T22:33:39.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5eb9767e-1f69-4a47-8234-1dacac30b7b2 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33962024-12-20T22:33:40.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6086464d-6fde-413e-9723-dec76d62a05f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33972024-12-20T22:33:40.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6086464d-6fde-413e-9723-dec76d62a05f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33982024-12-20T22:33:40.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6086464d-6fde-413e-9723-dec76d62a05f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
33992024-12-20T22:33:40.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
34002024-12-20T22:33:40.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34012024-12-20T22:33:40.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34022024-12-20T22:33:40.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
34032024-12-20T22:33:40.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34042024-12-20T22:33:40.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34052024-12-20T22:33:40.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34062024-12-20T22:33:40.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34072024-12-20T22:33:40.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34082024-12-20T22:33:40.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.814195ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34092024-12-20T22:33:40.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34102024-12-20T22:33:40.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34112024-12-20T22:33:40.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34122024-12-20T22:33:40.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34132024-12-20T22:33:40.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34142024-12-20T22:33:40.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34152024-12-20T22:33:40.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
34162024-12-20T22:33:40.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34172024-12-20T22:33:40.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34182024-12-20T22:33:40.595ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
34192024-12-20T22:33:40.595ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.864791ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
34202024-12-20T22:33:41.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 947adefd-9d65-40c1-943f-f93cea263cb7 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34212024-12-20T22:33:41.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 947adefd-9d65-40c1-943f-f93cea263cb7 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34222024-12-20T22:33:41.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 947adefd-9d65-40c1-943f-f93cea263cb7 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34232024-12-20T22:33:42.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a73f457d-c3d0-4203-bde9-ca8055ea9b44 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34242024-12-20T22:33:42.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a73f457d-c3d0-4203-bde9-ca8055ea9b44 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34252024-12-20T22:33:42.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a73f457d-c3d0-4203-bde9-ca8055ea9b44 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34262024-12-20T22:33:43.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4b45e860-2c64-4e8f-9092-93566bc89eb7 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34272024-12-20T22:33:43.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4b45e860-2c64-4e8f-9092-93566bc89eb7 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34282024-12-20T22:33:43.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2688 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4b45e860-2c64-4e8f-9092-93566bc89eb7 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34292024-12-20T22:33:44.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d8e42022-cf7c-4fba-a181-2d778172b1d9 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34302024-12-20T22:33:44.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d8e42022-cf7c-4fba-a181-2d778172b1d9 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34312024-12-20T22:33:44.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d8e42022-cf7c-4fba-a181-2d778172b1d9 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34322024-12-20T22:33:45.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 807a99e3-03eb-45f9-bb36-93e8d7aec268 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34332024-12-20T22:33:45.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 807a99e3-03eb-45f9-bb36-93e8d7aec268 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34342024-12-20T22:33:45.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 807a99e3-03eb-45f9-bb36-93e8d7aec268 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34352024-12-20T22:33:45.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 758 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 5423dbad-feed-4ee1-b82a-4c7fce2ec613 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
34362024-12-20T22:33:46.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b130b566-416f-4f54-be77-3eb4f3e6766f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34372024-12-20T22:33:46.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b130b566-416f-4f54-be77-3eb4f3e6766f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34382024-12-20T22:33:46.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b130b566-416f-4f54-be77-3eb4f3e6766f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34392024-12-20T22:33:47.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f8bf6496-c868-4343-bfb7-a28bde43ac88 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34402024-12-20T22:33:47.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f8bf6496-c868-4343-bfb7-a28bde43ac88 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34412024-12-20T22:33:47.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f8bf6496-c868-4343-bfb7-a28bde43ac88 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34422024-12-20T22:33:48.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2907bb02-6a21-4e20-8895-97711e696470 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34432024-12-20T22:33:48.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2907bb02-6a21-4e20-8895-97711e696470 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34442024-12-20T22:33:48.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2574 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2907bb02-6a21-4e20-8895-97711e696470 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34452024-12-20T22:33:49.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 58708baf-f697-4cfd-b15f-732f5e6a1eff roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34462024-12-20T22:33:49.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 58708baf-f697-4cfd-b15f-732f5e6a1eff resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34472024-12-20T22:33:49.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 58708baf-f697-4cfd-b15f-732f5e6a1eff response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34482024-12-20T22:33:50.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4a2864a4-65f2-49bc-8e76-235950c840c8 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34492024-12-20T22:33:50.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4a2864a4-65f2-49bc-8e76-235950c840c8 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34502024-12-20T22:33:50.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4a2864a4-65f2-49bc-8e76-235950c840c8 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34512024-12-20T22:33:50.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
34522024-12-20T22:33:50.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34532024-12-20T22:33:50.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34542024-12-20T22:33:50.572ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
34552024-12-20T22:33:50.572ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34562024-12-20T22:33:50.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34572024-12-20T22:33:50.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34582024-12-20T22:33:50.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34592024-12-20T22:33:50.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34602024-12-20T22:33:50.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34612024-12-20T22:33:50.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34622024-12-20T22:33:50.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34632024-12-20T22:33:50.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34642024-12-20T22:33:50.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34652024-12-20T22:33:50.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34662024-12-20T22:33:50.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
34672024-12-20T22:33:50.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34682024-12-20T22:33:50.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34692024-12-20T22:33:50.594ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
34702024-12-20T22:33:50.594ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.684389ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
34712024-12-20T22:33:50.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.307842ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34722024-12-20T22:33:51.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 325c8212-f278-44a0-a77b-ff349cfb415d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34732024-12-20T22:33:51.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 325c8212-f278-44a0-a77b-ff349cfb415d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34742024-12-20T22:33:51.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 325c8212-f278-44a0-a77b-ff349cfb415d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34752024-12-20T22:33:52.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3ff64383-d941-42b7-8d7b-9b5a0d92248e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34762024-12-20T22:33:52.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3ff64383-d941-42b7-8d7b-9b5a0d92248e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34772024-12-20T22:33:52.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3ff64383-d941-42b7-8d7b-9b5a0d92248e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34782024-12-20T22:33:53.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f91ced9a-afa0-459d-b976-f5520fa8d7ca roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34792024-12-20T22:33:53.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f91ced9a-afa0-459d-b976-f5520fa8d7ca resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34802024-12-20T22:33:53.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f91ced9a-afa0-459d-b976-f5520fa8d7ca response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34812024-12-20T22:33:54.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 442f2995-14c1-409a-be24-2e14a506322a roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34822024-12-20T22:33:54.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 442f2995-14c1-409a-be24-2e14a506322a resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34832024-12-20T22:33:54.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1845 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 442f2995-14c1-409a-be24-2e14a506322a response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34842024-12-20T22:33:55.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 547 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = cff3b0fa-a711-42b7-acd2-5bf311d1394c response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
34852024-12-20T22:33:55.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a765c120-96de-4c59-a358-55ca2249713c roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34862024-12-20T22:33:55.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a765c120-96de-4c59-a358-55ca2249713c resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34872024-12-20T22:33:55.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a765c120-96de-4c59-a358-55ca2249713c response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34882024-12-20T22:33:56.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2ea2109c-5daa-4002-a010-f813c13293e0 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34892024-12-20T22:33:56.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2ea2109c-5daa-4002-a010-f813c13293e0 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34902024-12-20T22:33:56.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2787 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2ea2109c-5daa-4002-a010-f813c13293e0 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34912024-12-20T22:33:57.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 750213e8-159e-4644-9b29-120ef46e2d4c roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34922024-12-20T22:33:57.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 750213e8-159e-4644-9b29-120ef46e2d4c resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34932024-12-20T22:33:57.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 750213e8-159e-4644-9b29-120ef46e2d4c response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34942024-12-20T22:33:58.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e0b54dc3-b0c5-4fcb-a078-1e7c63fe1f98 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34952024-12-20T22:33:58.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e0b54dc3-b0c5-4fcb-a078-1e7c63fe1f98 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34962024-12-20T22:33:58.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e0b54dc3-b0c5-4fcb-a078-1e7c63fe1f98 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34972024-12-20T22:33:59.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1326dbf9-96ab-4deb-affb-752ad7d39678 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34982024-12-20T22:33:59.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1326dbf9-96ab-4deb-affb-752ad7d39678 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
34992024-12-20T22:33:59.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1326dbf9-96ab-4deb-affb-752ad7d39678 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
35002024-12-20T22:34:00.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 23a90228-b211-4c1b-82be-72e097c07489 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
35012024-12-20T22:34:00.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 23a90228-b211-4c1b-82be-72e097c07489 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
35022024-12-20T22:34:00.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 23a90228-b211-4c1b-82be-72e097c07489 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
35032024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
35042024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
35052024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35062024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
35072024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
35082024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
35092024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
35102024-12-20T22:34:00.571ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:24:00.571128349 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
35112024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
35122024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
35132024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
35142024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35152024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
35162024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35172024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
35182024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
35192024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
35202024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
35212024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
35222024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35232024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
35242024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35252024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35262024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35272024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
35282024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35292024-12-20T22:34:00.571ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bcf7579-f08c-458a-b8fa-486beafab77e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c65750e1-e505-4d05-b242-145c69974016.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c65750e1-e505-4d05-b242-145c69974016.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1188, tv_nsec: 184273008 } })
35302024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
35312024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
35322024-12-20T22:34:00.571ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e
35332024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35342024-12-20T22:34:00.571ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.36\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e"}
35352024-12-20T22:34:00.571ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b172144-6fe3-403a-b88e-6be93db6788c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e1e925bb-4266-49d2-b532-0f79860badbb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9d7e78a-d944-4f23-9be0-86e0f1334a43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9d7e78a-d944-4f23-9be0-86e0f1334a43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1188, tv_nsec: 184483363 } })
35362024-12-20T22:34:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35372024-12-20T22:34:00.572ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
35382024-12-20T22:34:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 922.975\u{b5}s iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
35392024-12-20T22:34:00.572ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
35402024-12-20T22:34:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.380548ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
35412024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
35422024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35432024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
35442024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
35452024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35462024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35472024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
35482024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35492024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
35502024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35512024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35522024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
35532024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
35542024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35552024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35562024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35572024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
35582024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
35592024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35602024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
35612024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
35622024-12-20T22:34:00.573ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
35632024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
35642024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
35652024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
35662024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
35672024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
35682024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
35692024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
35702024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
35712024-12-20T22:34:00.573ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
35722024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35732024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
35742024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35752024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
35762024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35772024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
35782024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
35792024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35802024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35812024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35822024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35832024-12-20T22:34:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35842024-12-20T22:34:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
35852024-12-20T22:34:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
35862024-12-20T22:34:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35872024-12-20T22:34:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
35882024-12-20T22:34:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
35892024-12-20T22:34:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35902024-12-20T22:34:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35912024-12-20T22:34:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
35922024-12-20T22:34:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35932024-12-20T22:34:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35942024-12-20T22:34:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
35952024-12-20T22:34:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35962024-12-20T22:34:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35972024-12-20T22:34:00.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35982024-12-20T22:34:00.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1188, tv_nsec: 187184968 } })
35992024-12-20T22:34:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36002024-12-20T22:34:00.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1188, tv_nsec: 187313021 } })
36012024-12-20T22:34:00.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
36022024-12-20T22:34:00.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
36032024-12-20T22:34:00.575ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36042024-12-20T22:34:00.575ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.297288ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
36052024-12-20T22:34:00.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36062024-12-20T22:34:00.576ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:24:00.571128349 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
36072024-12-20T22:34:00.576ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.45576ms iteration = 9 status = {"expiration":"2024-12-20T22:24:00.571128349Z","pruned":[]}
36082024-12-20T22:34:00.577ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
36092024-12-20T22:34:00.577ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36102024-12-20T22:34:00.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36112024-12-20T22:34:00.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36122024-12-20T22:34:00.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36132024-12-20T22:34:00.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36142024-12-20T22:34:00.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36152024-12-20T22:34:00.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36162024-12-20T22:34:00.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36172024-12-20T22:34:00.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36182024-12-20T22:34:00.581ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.114394ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
36192024-12-20T22:34:00.581ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36202024-12-20T22:34:00.583ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.014286ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
36212024-12-20T22:34:00.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
36222024-12-20T22:34:00.583ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
36232024-12-20T22:34:00.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
36242024-12-20T22:34:00.585ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36252024-12-20T22:34:00.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36262024-12-20T22:34:00.590ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36272024-12-20T22:34:00.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
36282024-12-20T22:34:00.593ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36292024-12-20T22:34:00.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36302024-12-20T22:34:00.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36312024-12-20T22:34:00.598ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36322024-12-20T22:34:00.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36332024-12-20T22:34:00.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36342024-12-20T22:34:00.599ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36352024-12-20T22:34:00.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36362024-12-20T22:34:00.601ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36372024-12-20T22:34:00.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
36382024-12-20T22:34:00.606ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36392024-12-20T22:34:00.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36402024-12-20T22:34:00.617ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36412024-12-20T22:34:00.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36422024-12-20T22:34:00.619ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36432024-12-20T22:34:00.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36442024-12-20T22:34:00.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 6ccd5669-2159-4a0d-a2d2-cd8908fe2852 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
36452024-12-20T22:34:00.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 6ccd5669-2159-4a0d-a2d2-cd8908fe2852 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
36462024-12-20T22:34:00.642ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36472024-12-20T22:34:00.642ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
36482024-12-20T22:34:00.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36492024-12-20T22:34:00.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36502024-12-20T22:34:00.648ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 75.181945ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
36512024-12-20T22:34:00.654ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36522024-12-20T22:34:00.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 19545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 6ccd5669-2159-4a0d-a2d2-cd8908fe2852 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
36532024-12-20T22:34:00.654ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36542024-12-20T22:34:00.655ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36552024-12-20T22:34:00.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36562024-12-20T22:34:00.656ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36572024-12-20T22:34:00.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36582024-12-20T22:34:00.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36592024-12-20T22:34:00.658ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36602024-12-20T22:34:00.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
36612024-12-20T22:34:00.658ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36622024-12-20T22:34:00.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36632024-12-20T22:34:00.659ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
36642024-12-20T22:34:00.660ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
36652024-12-20T22:34:00.660ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 86.352683ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
36662024-12-20T22:34:00.660ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 87.068483ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36672024-12-20T22:34:00.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
36682024-12-20T22:34:00.661ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36692024-12-20T22:34:00.661ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
36702024-12-20T22:34:00.661ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
36712024-12-20T22:34:00.661ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
36722024-12-20T22:34:00.661ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36732024-12-20T22:34:00.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36742024-12-20T22:34:00.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36752024-12-20T22:34:00.662ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36762024-12-20T22:34:00.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36772024-12-20T22:34:00.663ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36782024-12-20T22:34:00.663ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36792024-12-20T22:34:00.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36802024-12-20T22:34:00.666ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36812024-12-20T22:34:00.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36822024-12-20T22:34:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36832024-12-20T22:34:00.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36842024-12-20T22:34:00.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36852024-12-20T22:34:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36862024-12-20T22:34:00.668ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36872024-12-20T22:34:00.668ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1188, tv_nsec: 281345296 } })
36882024-12-20T22:34:00.669ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
36892024-12-20T22:34:00.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36902024-12-20T22:34:00.669ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36912024-12-20T22:34:00.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36922024-12-20T22:34:00.670ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36932024-12-20T22:34:00.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36942024-12-20T22:34:00.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36952024-12-20T22:34:00.672ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36962024-12-20T22:34:00.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36972024-12-20T22:34:00.673ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
36982024-12-20T22:34:00.673ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
36992024-12-20T22:34:00.673ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
37002024-12-20T22:34:00.673ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
37012024-12-20T22:34:00.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
37022024-12-20T22:34:00.675ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 101.647076ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37032024-12-20T22:34:00.676ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
37042024-12-20T22:34:00.676ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
37052024-12-20T22:34:00.676ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 102.458668ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
37062024-12-20T22:34:00.678ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37072024-12-20T22:34:00.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
37082024-12-20T22:34:00.681ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37092024-12-20T22:34:00.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37102024-12-20T22:34:00.685ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37112024-12-20T22:34:00.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
37122024-12-20T22:34:00.687ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
37132024-12-20T22:34:00.687ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 113.595295ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
37142024-12-20T22:34:00.687ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37152024-12-20T22:34:00.690ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
37162024-12-20T22:34:00.690ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37172024-12-20T22:34:00.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
37182024-12-20T22:34:00.699ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
37192024-12-20T22:34:00.699ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 127.650403ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
37202024-12-20T22:34:00.705ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
37212024-12-20T22:34:00.712ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37222024-12-20T22:34:00.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37232024-12-20T22:34:00.713ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
37242024-12-20T22:34:00.713ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37252024-12-20T22:34:00.713ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "115353d3-b795-4a10-b1b2-6a605bfe3ecf", "content-length": "26", "date": "Fri, 20 Dec 2024 22:34:00 GMT"} })
37262024-12-20T22:34:00.713ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37272024-12-20T22:34:00.716ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37282024-12-20T22:34:00.716ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37292024-12-20T22:34:00.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37302024-12-20T22:34:00.718ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37312024-12-20T22:34:00.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
37322024-12-20T22:34:00.721ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37332024-12-20T22:34:00.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37342024-12-20T22:34:00.722ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 148.480668ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37352024-12-20T22:34:00.723ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
37362024-12-20T22:34:00.723ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 150.362859ms iteration = 17 status = 0
37372024-12-20T22:34:00.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
37382024-12-20T22:34:00.725ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37392024-12-20T22:34:00.725ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
37402024-12-20T22:34:00.725ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37412024-12-20T22:34:00.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37422024-12-20T22:34:00.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 153.761523ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
37432024-12-20T22:34:00.736ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
37442024-12-20T22:34:00.736ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 0 version = 2
37452024-12-20T22:34:00.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37462024-12-20T22:34:00.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37472024-12-20T22:34:00.737ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37482024-12-20T22:34:00.738ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37492024-12-20T22:34:00.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
37502024-12-20T22:34:00.740ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
37512024-12-20T22:34:00.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
37522024-12-20T22:34:00.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
37532024-12-20T22:34:00.741ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37542024-12-20T22:34:00.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37552024-12-20T22:34:00.745ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:25:57.040586Z, time_modified: 2024-12-20T22:25:57.040586Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }) }
37562024-12-20T22:34:00.745ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 174.463215ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]}},"default_endpoint":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
37572024-12-20T22:34:00.748ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 1 version = 2
37582024-12-20T22:34:00.748ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
37592024-12-20T22:34:00.748ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:26:40.428768 UTC dns_group = external generation = 2
37602024-12-20T22:34:00.748ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 177.119078ms iteration = 9 status = {"generation":2}
37612024-12-20T22:34:00.765ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37622024-12-20T22:34:00.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37632024-12-20T22:34:00.772ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37642024-12-20T22:34:00.772ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
37652024-12-20T22:34:00.772ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 198.791936ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
37662024-12-20T22:34:00.789ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 216.33124ms iteration = 19 status = {"physical_disks_added":0}
37672024-12-20T22:34:00.793ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
37682024-12-20T22:34:00.793ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
37692024-12-20T22:34:00.793ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
37702024-12-20T22:34:00.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
37712024-12-20T22:34:00.815ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37722024-12-20T22:34:00.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37732024-12-20T22:34:00.834ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 zone_address = fd00:1122:3344:101::2
37742024-12-20T22:34:00.834ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37752024-12-20T22:34:00.834ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0d5d617-516b-45b0-bf73-9644266baa86", "content-length": "26", "date": "Fri, 20 Dec 2024 22:34:00 GMT"} })
37762024-12-20T22:34:00.834ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37772024-12-20T22:34:00.836ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
37782024-12-20T22:34:00.845ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
37792024-12-20T22:34:00.845ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 271.546924ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
37802024-12-20T22:34:00.846ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
37812024-12-20T22:34:00.876ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
37822024-12-20T22:34:00.876ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37832024-12-20T22:34:00.876ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2df44986-335e-443f-88d7-c80c92075413", "content-length": "26", "date": "Fri, 20 Dec 2024 22:34:00 GMT"} })
37842024-12-20T22:34:00.876ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37852024-12-20T22:34:00.878ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37862024-12-20T22:34:00.885ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
37872024-12-20T22:34:00.975ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 404.741149ms iteration = 17 status = {}
37882024-12-20T22:34:01.039ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
37892024-12-20T22:34:01.039ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37902024-12-20T22:34:01.040ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "899d3c83-ce7d-4d6c-92db-45a2db8a2e6c", "content-length": "372", "date": "Fri, 20 Dec 2024 22:34:00 GMT"} })
37912024-12-20T22:34:01.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37922024-12-20T22:34:01.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37932024-12-20T22:34:01.041ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
37942024-12-20T22:34:01.041ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "2637a626-4bfe-4a4f-ac35-9b391b0b0297", "date": "Fri, 20 Dec 2024 22:34:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37952024-12-20T22:34:01.041ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37962024-12-20T22:34:01.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37972024-12-20T22:34:01.042ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37982024-12-20T22:34:01.043ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5125a3fe-25a1-478e-8bbe-38a5f6328256", "date": "Fri, 20 Dec 2024 22:34:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
37992024-12-20T22:34:01.043ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
38002024-12-20T22:34:01.044ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38012024-12-20T22:34:01.044ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38022024-12-20T22:34:01.045ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "fc238c81-a798-40bf-84e5-2502df908f5b", "date": "Fri, 20 Dec 2024 22:34:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
38032024-12-20T22:34:01.045ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
38042024-12-20T22:34:01.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38052024-12-20T22:34:01.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
38062024-12-20T22:34:01.045ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38072024-12-20T22:34:01.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38082024-12-20T22:34:01.046ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
38092024-12-20T22:34:01.046ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 475.840151ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
38102024-12-20T22:34:01.046ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38112024-12-20T22:34:01.048ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
38122024-12-20T22:34:01.048ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
38132024-12-20T22:34:01.048ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
38142024-12-20T22:34:01.048ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38152024-12-20T22:34:01.048ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38162024-12-20T22:34:01.048ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:26:39.700273 UTC dns_group = internal generation = 1
38172024-12-20T22:34:01.048ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 477.553899ms iteration = 9 status = {"generation":1}
38182024-12-20T22:34:01.048ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "895ae924-128c-42d4-be1e-538eb56e0249", "content-length": "1", "date": "Fri, 20 Dec 2024 22:34:00 GMT"} })
38192024-12-20T22:34:01.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38202024-12-20T22:34:01.050ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38212024-12-20T22:34:01.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38222024-12-20T22:34:01.053ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 482.451364ms iteration = 17 status = null
38232024-12-20T22:34:01.097ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
38242024-12-20T22:34:01.097ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
38252024-12-20T22:34:01.098ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f989e6e8-c908-4bca-aa54-d7a75a29195d", "date": "Fri, 20 Dec 2024 22:34:01 GMT"} })
38262024-12-20T22:34:01.098ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38272024-12-20T22:34:01.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38282024-12-20T22:34:01.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38292024-12-20T22:34:01.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38302024-12-20T22:34:01.103ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38312024-12-20T22:34:01.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38322024-12-20T22:34:01.154ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
38332024-12-20T22:34:01.154ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "08c5d69d-44fa-4543-ad16-7bc13c808f38", "date": "Fri, 20 Dec 2024 22:34:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
38342024-12-20T22:34:01.154ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
38352024-12-20T22:34:01.156ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "00e90a4b-aa6e-41fe-847d-7d7a954bf768", "date": "Fri, 20 Dec 2024 22:34:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
38362024-12-20T22:34:01.156ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
38372024-12-20T22:34:01.158ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
38382024-12-20T22:34:01.158ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 586.964018ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
38392024-12-20T22:34:01.243ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
38402024-12-20T22:34:01.243ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6dd5f21-d9f4-44d9-b285-edad6d07eb26", "content-length": "691", "date": "Fri, 20 Dec 2024 22:34:01 GMT"} })
38412024-12-20T22:34:01.243ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
38422024-12-20T22:34:01.243ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
38432024-12-20T22:34:01.243ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
38442024-12-20T22:34:01.244ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 671.246774ms iteration = 17 status = {}
38452024-12-20T22:34:01.246ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
38462024-12-20T22:34:01.246ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38472024-12-20T22:34:01.247ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ae987dc6-370c-43ec-9fa3-cdb9ad1da38e", "date": "Fri, 20 Dec 2024 22:34:01 GMT"} })
38482024-12-20T22:34:01.249ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 675.45076ms iteration = 17 status = {}
38492024-12-20T22:34:01.279ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38502024-12-20T22:34:01.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38512024-12-20T22:34:01.282ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9fedf0d4-8a86-4506-bf93-224faabd5e37, rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b26f0563-25fb-4d7c-8480-dd368ac01105) } rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
38522024-12-20T22:34:01.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38532024-12-20T22:34:01.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38542024-12-20T22:34:01.292ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
38552024-12-20T22:34:01.292ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7b76f06-e43b-40d0-a409-23efafc32abb", "content-length": "134", "date": "Fri, 20 Dec 2024 22:34:00 GMT"} })
38562024-12-20T22:34:01.292ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
38572024-12-20T22:34:01.292ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b26f0563-25fb-4d7c-8480-dd368ac01105
38582024-12-20T22:34:01.292ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
38592024-12-20T22:34:01.292ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38602024-12-20T22:34:01.292ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38612024-12-20T22:34:01.292ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38622024-12-20T22:34:01.292ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38632024-12-20T22:34:01.292ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38642024-12-20T22:34:01.293ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38652024-12-20T22:34:01.293ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38662024-12-20T22:34:01.293ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
38672024-12-20T22:34:01.293ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38682024-12-20T22:34:01.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38692024-12-20T22:34:01.295ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
38702024-12-20T22:34:01.295ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a108e0cd-a18d-49ba-a194-4553ba580593", "content-length": "2", "date": "Fri, 20 Dec 2024 22:34:00 GMT"} })
38712024-12-20T22:34:01.295ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
38722024-12-20T22:34:01.296ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b50f5863-a687-4aac-9d21-452e10a20b6a", "content-length": "52", "date": "Fri, 20 Dec 2024 22:34:00 GMT"} })
38732024-12-20T22:34:01.296ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
38742024-12-20T22:34:01.296ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38752024-12-20T22:34:01.390ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "22cf1025-5f8b-437e-92f6-26b9898aeee4", "date": "Fri, 20 Dec 2024 22:34:01 GMT"} })
38762024-12-20T22:34:01.390ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch = Switch0
38772024-12-20T22:34:01.390ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38782024-12-20T22:34:01.390ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "157a8b51-f83f-4859-a879-704b0394c1f7", "content-length": "682", "date": "Fri, 20 Dec 2024 22:34:01 GMT"} })
38792024-12-20T22:34:01.390ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38802024-12-20T22:34:01.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38812024-12-20T22:34:01.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38822024-12-20T22:34:01.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38832024-12-20T22:34:01.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38842024-12-20T22:34:01.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38852024-12-20T22:34:01.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38862024-12-20T22:34:01.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38872024-12-20T22:34:01.408ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 834.8851ms iteration = 17 status = {}
38882024-12-20T22:34:01.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c2d1eb59-7030-4beb-84c7-45f7bfd17d11 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
38892024-12-20T22:34:01.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c2d1eb59-7030-4beb-84c7-45f7bfd17d11 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
38902024-12-20T22:34:01.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c2d1eb59-7030-4beb-84c7-45f7bfd17d11 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
38912024-12-20T22:34:02.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 726a5d25-d149-4072-9409-fbc1b3c2d992 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
38922024-12-20T22:34:02.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 726a5d25-d149-4072-9409-fbc1b3c2d992 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
38932024-12-20T22:34:02.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 726a5d25-d149-4072-9409-fbc1b3c2d992 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
38942024-12-20T22:34:03.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 80b4aa9d-c446-4a77-8c68-aa11afd63121 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
38952024-12-20T22:34:03.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 80b4aa9d-c446-4a77-8c68-aa11afd63121 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
38962024-12-20T22:34:03.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 80b4aa9d-c446-4a77-8c68-aa11afd63121 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
38972024-12-20T22:34:04.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7e638f5b-6932-4ae7-8b6a-bd4a248fd97f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
38982024-12-20T22:34:04.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7e638f5b-6932-4ae7-8b6a-bd4a248fd97f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
38992024-12-20T22:34:04.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7e638f5b-6932-4ae7-8b6a-bd4a248fd97f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39002024-12-20T22:34:05.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 658 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 0317f0d4-4993-47e7-9601-445459016452 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
39012024-12-20T22:34:05.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 62645a85-ba3e-454a-aceb-440b7b5576c4 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39022024-12-20T22:34:05.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 62645a85-ba3e-454a-aceb-440b7b5576c4 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39032024-12-20T22:34:05.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 62645a85-ba3e-454a-aceb-440b7b5576c4 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39042024-12-20T22:34:06.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b58f49e5-a8f2-42ad-af21-59be6731a3fe roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39052024-12-20T22:34:06.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b58f49e5-a8f2-42ad-af21-59be6731a3fe resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39062024-12-20T22:34:06.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b58f49e5-a8f2-42ad-af21-59be6731a3fe response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39072024-12-20T22:34:07.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c5bf059c-e08e-4f8f-887b-0dea0f9c262d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39082024-12-20T22:34:07.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c5bf059c-e08e-4f8f-887b-0dea0f9c262d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39092024-12-20T22:34:07.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c5bf059c-e08e-4f8f-887b-0dea0f9c262d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39102024-12-20T22:34:08.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b0a31013-1194-4be2-bf02-14b0d9b94706 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39112024-12-20T22:34:08.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b0a31013-1194-4be2-bf02-14b0d9b94706 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39122024-12-20T22:34:08.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b0a31013-1194-4be2-bf02-14b0d9b94706 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39132024-12-20T22:34:09.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a5b3ad1d-845a-4807-894c-2ae4768067c8 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39142024-12-20T22:34:09.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a5b3ad1d-845a-4807-894c-2ae4768067c8 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39152024-12-20T22:34:09.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a5b3ad1d-845a-4807-894c-2ae4768067c8 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39162024-12-20T22:34:10.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
39172024-12-20T22:34:10.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39182024-12-20T22:34:10.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39192024-12-20T22:34:10.572ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
39202024-12-20T22:34:10.572ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39212024-12-20T22:34:10.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39222024-12-20T22:34:10.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39232024-12-20T22:34:10.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39242024-12-20T22:34:10.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39252024-12-20T22:34:10.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39262024-12-20T22:34:10.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39272024-12-20T22:34:10.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39282024-12-20T22:34:10.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39292024-12-20T22:34:10.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
39302024-12-20T22:34:10.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39312024-12-20T22:34:10.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39322024-12-20T22:34:10.595ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
39332024-12-20T22:34:10.595ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.380205ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
39342024-12-20T22:34:10.614ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39352024-12-20T22:34:10.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39362024-12-20T22:34:10.616ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.380157ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39372024-12-20T22:34:10.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = bc8f5116-d436-4310-a388-67d35b220dce roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39382024-12-20T22:34:10.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = bc8f5116-d436-4310-a388-67d35b220dce resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39392024-12-20T22:34:10.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = bc8f5116-d436-4310-a388-67d35b220dce response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39402024-12-20T22:34:11.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f0b0309a-ba88-4c44-9d53-50b0a8c6dc9f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39412024-12-20T22:34:11.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f0b0309a-ba88-4c44-9d53-50b0a8c6dc9f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39422024-12-20T22:34:11.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f0b0309a-ba88-4c44-9d53-50b0a8c6dc9f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39432024-12-20T22:34:12.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8687c34e-f618-4d5a-97d6-755cb9beafa2 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39442024-12-20T22:34:12.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8687c34e-f618-4d5a-97d6-755cb9beafa2 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39452024-12-20T22:34:12.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8687c34e-f618-4d5a-97d6-755cb9beafa2 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39462024-12-20T22:34:13.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a3195116-eb67-4342-acce-f58b07da8765 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39472024-12-20T22:34:13.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a3195116-eb67-4342-acce-f58b07da8765 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39482024-12-20T22:34:13.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1798 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a3195116-eb67-4342-acce-f58b07da8765 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39492024-12-20T22:34:14.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5cb6021e-d081-49bb-8ccb-723db7e0088e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39502024-12-20T22:34:14.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5cb6021e-d081-49bb-8ccb-723db7e0088e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39512024-12-20T22:34:14.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5cb6021e-d081-49bb-8ccb-723db7e0088e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39522024-12-20T22:34:15.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 525 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 965e946b-8488-4160-b43c-9514848f36eb response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
39532024-12-20T22:34:15.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e4f80cc8-32ec-47bc-8c79-c45aa42552ce roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39542024-12-20T22:34:15.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e4f80cc8-32ec-47bc-8c79-c45aa42552ce resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39552024-12-20T22:34:15.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e4f80cc8-32ec-47bc-8c79-c45aa42552ce response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39562024-12-20T22:34:16.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 192f8b91-0a8b-4f78-8cf4-dec64c37a502 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39572024-12-20T22:34:16.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 192f8b91-0a8b-4f78-8cf4-dec64c37a502 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39582024-12-20T22:34:16.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 192f8b91-0a8b-4f78-8cf4-dec64c37a502 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39592024-12-20T22:34:17.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1253802b-9110-464a-8588-b62053d668f5 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39602024-12-20T22:34:17.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1253802b-9110-464a-8588-b62053d668f5 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39612024-12-20T22:34:17.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1253802b-9110-464a-8588-b62053d668f5 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39622024-12-20T22:34:18.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ebc211d2-3218-4111-9716-e58e519df6d1 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39632024-12-20T22:34:18.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ebc211d2-3218-4111-9716-e58e519df6d1 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39642024-12-20T22:34:18.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ebc211d2-3218-4111-9716-e58e519df6d1 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39652024-12-20T22:34:19.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e99a298f-667f-498b-82dd-ee2e1eecb2ab roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39662024-12-20T22:34:19.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e99a298f-667f-498b-82dd-ee2e1eecb2ab resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39672024-12-20T22:34:19.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e99a298f-667f-498b-82dd-ee2e1eecb2ab response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39682024-12-20T22:34:20.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
39692024-12-20T22:34:20.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39702024-12-20T22:34:20.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39712024-12-20T22:34:20.572ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
39722024-12-20T22:34:20.572ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39732024-12-20T22:34:20.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39742024-12-20T22:34:20.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39752024-12-20T22:34:20.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39762024-12-20T22:34:20.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39772024-12-20T22:34:20.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39782024-12-20T22:34:20.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39792024-12-20T22:34:20.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39802024-12-20T22:34:20.576ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.027181ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39812024-12-20T22:34:20.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39822024-12-20T22:34:20.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39832024-12-20T22:34:20.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39842024-12-20T22:34:20.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
39852024-12-20T22:34:20.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39862024-12-20T22:34:20.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39872024-12-20T22:34:20.594ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
39882024-12-20T22:34:20.594ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.292705ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
39892024-12-20T22:34:20.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9e5dd7c0-8db0-4d53-b0b9-3989dd62bf6b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39902024-12-20T22:34:20.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9e5dd7c0-8db0-4d53-b0b9-3989dd62bf6b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39912024-12-20T22:34:20.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9e5dd7c0-8db0-4d53-b0b9-3989dd62bf6b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39922024-12-20T22:34:22.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 829408b9-2e4f-46b5-8c88-da63ec551bd3 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39932024-12-20T22:34:22.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 829408b9-2e4f-46b5-8c88-da63ec551bd3 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39942024-12-20T22:34:22.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 829408b9-2e4f-46b5-8c88-da63ec551bd3 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39952024-12-20T22:34:23.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fb8c210f-0a95-4fb5-a844-4341635cc6f6 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39962024-12-20T22:34:23.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fb8c210f-0a95-4fb5-a844-4341635cc6f6 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39972024-12-20T22:34:23.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fb8c210f-0a95-4fb5-a844-4341635cc6f6 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39982024-12-20T22:34:24.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 22b86499-b7f0-475f-95f6-ba739e329a7f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
39992024-12-20T22:34:24.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 22b86499-b7f0-475f-95f6-ba739e329a7f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
40002024-12-20T22:34:24.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2814 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 22b86499-b7f0-475f-95f6-ba739e329a7f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
40012024-12-20T22:34:25.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f6a140b2-93ec-4a4d-92cf-982f8af82549 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
40022024-12-20T22:34:25.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f6a140b2-93ec-4a4d-92cf-982f8af82549 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
40032024-12-20T22:34:25.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f6a140b2-93ec-4a4d-92cf-982f8af82549 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
40042024-12-20T22:34:25.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 642 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = e758ec9c-75f9-4221-907b-a6f85473ed84 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
40052024-12-20T22:34:26.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f2015a6f-db24-4156-b32c-4f6cf4a72540 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
40062024-12-20T22:34:26.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f2015a6f-db24-4156-b32c-4f6cf4a72540 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
40072024-12-20T22:34:26.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f2015a6f-db24-4156-b32c-4f6cf4a72540 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
40082024-12-20T22:34:27.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 33e0642d-f19a-4a0a-afc9-98d2551ac487 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
40092024-12-20T22:34:27.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 33e0642d-f19a-4a0a-afc9-98d2551ac487 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
40102024-12-20T22:34:27.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 33e0642d-f19a-4a0a-afc9-98d2551ac487 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
40112024-12-20T22:34:28.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c76d9d45-e6a8-441d-99f0-744f4b99908f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
40122024-12-20T22:34:28.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c76d9d45-e6a8-441d-99f0-744f4b99908f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
40132024-12-20T22:34:28.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1896 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c76d9d45-e6a8-441d-99f0-744f4b99908f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
40142024-12-20T22:34:29.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f54d9eae-8719-45fb-95d2-ce30127131a7 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
40152024-12-20T22:34:29.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f54d9eae-8719-45fb-95d2-ce30127131a7 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
40162024-12-20T22:34:29.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f54d9eae-8719-45fb-95d2-ce30127131a7 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
40172024-12-20T22:34:30.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 574b4734-939a-4067-be1a-2f0025eec681 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
40182024-12-20T22:34:30.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 574b4734-939a-4067-be1a-2f0025eec681 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
40192024-12-20T22:34:30.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 574b4734-939a-4067-be1a-2f0025eec681 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
40202024-12-20T22:34:30.571ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
40212024-12-20T22:34:30.571ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40222024-12-20T22:34:30.571ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
40232024-12-20T22:34:30.571ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
40242024-12-20T22:34:30.571ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
40252024-12-20T22:34:30.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40262024-12-20T22:34:30.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
40272024-12-20T22:34:30.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
40282024-12-20T22:34:30.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40292024-12-20T22:34:30.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40302024-12-20T22:34:30.572ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
40312024-12-20T22:34:30.572ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40322024-12-20T22:34:30.572ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
40332024-12-20T22:34:30.572ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
40342024-12-20T22:34:30.572ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
40352024-12-20T22:34:30.572ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40362024-12-20T22:34:30.572ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
40372024-12-20T22:34:30.572ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
40382024-12-20T22:34:30.572ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
40392024-12-20T22:34:30.572ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40402024-12-20T22:34:30.572ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40412024-12-20T22:34:30.572ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
40422024-12-20T22:34:30.572ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40432024-12-20T22:34:30.572ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
40442024-12-20T22:34:30.572ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
40452024-12-20T22:34:30.572ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40462024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
40472024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40482024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
40492024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
40502024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
40512024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40522024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
40532024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40542024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
40552024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40562024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
40572024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40582024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
40592024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40602024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40612024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40622024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40632024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40642024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40652024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40662024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40672024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40682024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40692024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40702024-12-20T22:34:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
40712024-12-20T22:34:30.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1218, tv_nsec: 187306551 } })
40722024-12-20T22:34:30.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1218, tv_nsec: 187455935 } })
40732024-12-20T22:34:30.575ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
40742024-12-20T22:34:30.575ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
40752024-12-20T22:34:30.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40762024-12-20T22:34:30.575ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.574429ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
40772024-12-20T22:34:30.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40782024-12-20T22:34:30.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40792024-12-20T22:34:30.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40802024-12-20T22:34:30.577ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40812024-12-20T22:34:30.577ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40822024-12-20T22:34:30.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40832024-12-20T22:34:30.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40842024-12-20T22:34:30.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40852024-12-20T22:34:30.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40862024-12-20T22:34:30.579ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40872024-12-20T22:34:30.582ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40882024-12-20T22:34:30.582ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
40892024-12-20T22:34:30.582ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40902024-12-20T22:34:30.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40912024-12-20T22:34:30.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40922024-12-20T22:34:30.584ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40932024-12-20T22:34:30.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40942024-12-20T22:34:30.585ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40952024-12-20T22:34:30.585ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40962024-12-20T22:34:30.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40972024-12-20T22:34:30.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40982024-12-20T22:34:30.587ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40992024-12-20T22:34:30.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41002024-12-20T22:34:30.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41012024-12-20T22:34:30.588ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41022024-12-20T22:34:30.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
41032024-12-20T22:34:30.588ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41042024-12-20T22:34:30.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41052024-12-20T22:34:30.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41062024-12-20T22:34:30.590ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41072024-12-20T22:34:30.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41082024-12-20T22:34:30.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41092024-12-20T22:34:30.593ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41102024-12-20T22:34:30.593ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41112024-12-20T22:34:30.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41122024-12-20T22:34:30.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41132024-12-20T22:34:30.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41142024-12-20T22:34:30.593ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41152024-12-20T22:34:30.593ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
41162024-12-20T22:34:30.593ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41172024-12-20T22:34:30.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41182024-12-20T22:34:30.594ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41192024-12-20T22:34:30.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41202024-12-20T22:34:30.595ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1218, tv_nsec: 208223658 } })
41212024-12-20T22:34:30.595ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41222024-12-20T22:34:30.595ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
41232024-12-20T22:34:30.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41242024-12-20T22:34:30.628ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41252024-12-20T22:34:30.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41262024-12-20T22:34:30.631ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41272024-12-20T22:34:30.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41282024-12-20T22:34:30.636ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41292024-12-20T22:34:30.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41302024-12-20T22:34:30.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.429449ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
41312024-12-20T22:34:30.642ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41322024-12-20T22:34:30.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41332024-12-20T22:34:30.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.700901ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
41342024-12-20T22:34:30.644ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 71.552864ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41352024-12-20T22:34:30.646ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41362024-12-20T22:34:30.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41372024-12-20T22:34:30.649ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 76.563973ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41382024-12-20T22:34:30.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41392024-12-20T22:34:30.662ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41402024-12-20T22:34:30.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41412024-12-20T22:34:30.664ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41422024-12-20T22:34:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
41432024-12-20T22:34:30.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41442024-12-20T22:34:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41452024-12-20T22:34:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41462024-12-20T22:34:30.666ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
41472024-12-20T22:34:30.666ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 93.341096ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
41482024-12-20T22:34:30.666ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41492024-12-20T22:34:30.666ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
41502024-12-20T22:34:30.666ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 93.915472ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
41512024-12-20T22:34:30.669ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
41522024-12-20T22:34:30.669ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41532024-12-20T22:34:30.669ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3059c468-e838-4d2a-9793-3deb45721db2", "content-length": "26", "date": "Fri, 20 Dec 2024 22:34:30 GMT"} })
41542024-12-20T22:34:30.669ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41552024-12-20T22:34:30.671ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41562024-12-20T22:34:30.671ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
41572024-12-20T22:34:30.671ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41582024-12-20T22:34:30.671ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "79d03867-fdd9-4391-bae0-c6da56e23d55", "content-length": "26", "date": "Fri, 20 Dec 2024 22:34:30 GMT"} })
41592024-12-20T22:34:30.671ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41602024-12-20T22:34:30.673ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41612024-12-20T22:34:30.675ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
41622024-12-20T22:34:30.675ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 103.140926ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
41632024-12-20T22:34:30.684ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41642024-12-20T22:34:30.684ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41652024-12-20T22:34:30.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41662024-12-20T22:34:30.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 0a1bd525-d3e1-453e-8805-18ff32dd9318 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
41672024-12-20T22:34:30.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 0a1bd525-d3e1-453e-8805-18ff32dd9318 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
41682024-12-20T22:34:30.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
41692024-12-20T22:34:30.687ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41702024-12-20T22:34:30.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41712024-12-20T22:34:30.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3629 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 0a1bd525-d3e1-453e-8805-18ff32dd9318 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
41722024-12-20T22:34:30.689ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 116.368962ms iteration = 18 status = 0
41732024-12-20T22:34:30.691ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 zone_address = fd00:1122:3344:101::2
41742024-12-20T22:34:30.691ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41752024-12-20T22:34:30.692ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fb31193-ff94-4e79-a1e6-5b605f610e11", "content-length": "26", "date": "Fri, 20 Dec 2024 22:34:30 GMT"} })
41762024-12-20T22:34:30.692ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41772024-12-20T22:34:30.693ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
41782024-12-20T22:34:30.700ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 127.529169ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41792024-12-20T22:34:30.726ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 153.24881ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
41802024-12-20T22:34:30.762ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41812024-12-20T22:34:30.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41822024-12-20T22:34:30.770ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41832024-12-20T22:34:30.771ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cab82496-ef32-46bd-9469-26fe98c4e5ea", "content-length": "1", "date": "Fri, 20 Dec 2024 22:34:30 GMT"} })
41842024-12-20T22:34:30.772ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41852024-12-20T22:34:30.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41862024-12-20T22:34:30.775ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 203.463854ms iteration = 18 status = null
41872024-12-20T22:34:30.781ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 209.43651ms iteration = 18 status = {}
41882024-12-20T22:34:30.800ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
41892024-12-20T22:34:30.800ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41902024-12-20T22:34:30.801ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "26e1c2d0-f3bd-4135-ab9b-a3efdeb137a0", "content-length": "372", "date": "Fri, 20 Dec 2024 22:34:29 GMT"} })
41912024-12-20T22:34:30.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41922024-12-20T22:34:30.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41932024-12-20T22:34:30.803ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 230.223714ms iteration = 20 status = {"physical_disks_added":0}
41942024-12-20T22:34:30.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41952024-12-20T22:34:30.807ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41962024-12-20T22:34:30.807ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41972024-12-20T22:34:30.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41982024-12-20T22:34:30.808ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41992024-12-20T22:34:30.810ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42002024-12-20T22:34:30.810ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42012024-12-20T22:34:30.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42022024-12-20T22:34:30.854ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
42032024-12-20T22:34:30.854ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
42042024-12-20T22:34:30.854ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4c60a2a6-5b64-41a6-bd91-89a2ac767c67", "date": "Fri, 20 Dec 2024 22:34:30 GMT"} })
42052024-12-20T22:34:30.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42062024-12-20T22:34:30.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42072024-12-20T22:34:30.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42082024-12-20T22:34:30.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42092024-12-20T22:34:30.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42102024-12-20T22:34:30.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42112024-12-20T22:34:30.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42122024-12-20T22:34:30.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42132024-12-20T22:34:30.863ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
42142024-12-20T22:34:30.863ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42152024-12-20T22:34:30.863ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4cf8c337-9839-4880-9fa9-e43baf766e8c", "date": "Fri, 20 Dec 2024 22:34:30 GMT"} })
42162024-12-20T22:34:30.865ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9fedf0d4-8a86-4506-bf93-224faabd5e37, rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b26f0563-25fb-4d7c-8480-dd368ac01105) } rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
42172024-12-20T22:34:30.865ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42182024-12-20T22:34:30.865ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 292.394409ms iteration = 18 status = {}
42192024-12-20T22:34:30.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42202024-12-20T22:34:30.874ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
42212024-12-20T22:34:30.874ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ea98f3b-20e1-490f-9cf2-a5bec884f56a", "content-length": "134", "date": "Fri, 20 Dec 2024 22:34:30 GMT"} })
42222024-12-20T22:34:30.875ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
42232024-12-20T22:34:30.875ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b26f0563-25fb-4d7c-8480-dd368ac01105
42242024-12-20T22:34:30.875ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
42252024-12-20T22:34:30.875ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42262024-12-20T22:34:30.875ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42272024-12-20T22:34:30.875ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42282024-12-20T22:34:30.875ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42292024-12-20T22:34:30.875ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42302024-12-20T22:34:30.875ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42312024-12-20T22:34:30.875ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42322024-12-20T22:34:30.875ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
42332024-12-20T22:34:30.875ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42342024-12-20T22:34:30.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42352024-12-20T22:34:30.878ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
42362024-12-20T22:34:30.878ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "40ca0d3b-0564-4ae9-ad7f-a0d5c86f7829", "content-length": "2", "date": "Fri, 20 Dec 2024 22:34:30 GMT"} })
42372024-12-20T22:34:30.878ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
42382024-12-20T22:34:30.878ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b10e0fe-91e6-4efa-90ed-8e2514d4c4e7", "content-length": "52", "date": "Fri, 20 Dec 2024 22:34:30 GMT"} })
42392024-12-20T22:34:30.878ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
42402024-12-20T22:34:30.878ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
42412024-12-20T22:34:30.929ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
42422024-12-20T22:34:30.979ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "891bb92e-2a63-4dd6-aacc-40540c263e75", "date": "Fri, 20 Dec 2024 22:34:30 GMT"} })
42432024-12-20T22:34:30.979ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch = Switch0
42442024-12-20T22:34:30.979ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
42452024-12-20T22:34:30.979ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0f064e9-ad50-4e36-b328-f7945efbadd9", "content-length": "691", "date": "Fri, 20 Dec 2024 22:34:30 GMT"} })
42462024-12-20T22:34:30.979ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
42472024-12-20T22:34:30.979ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
42482024-12-20T22:34:30.979ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
42492024-12-20T22:34:30.979ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "93d22fe4-87c0-46ae-957a-fb7a29b39286", "content-length": "682", "date": "Fri, 20 Dec 2024 22:34:30 GMT"} })
42502024-12-20T22:34:30.979ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42512024-12-20T22:34:30.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42522024-12-20T22:34:30.981ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 408.125793ms iteration = 18 status = {}
42532024-12-20T22:34:30.984ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42542024-12-20T22:34:30.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42552024-12-20T22:34:30.987ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42562024-12-20T22:34:30.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42572024-12-20T22:34:30.989ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42582024-12-20T22:34:30.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42592024-12-20T22:34:30.995ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 422.744576ms iteration = 18 status = {}
42602024-12-20T22:34:31.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 95d6a519-e1c3-4882-9c5c-64d8061b11b5 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
42612024-12-20T22:34:31.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 95d6a519-e1c3-4882-9c5c-64d8061b11b5 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
42622024-12-20T22:34:31.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 95d6a519-e1c3-4882-9c5c-64d8061b11b5 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
42632024-12-20T22:34:31.281ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
42642024-12-20T22:34:31.281ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
42652024-12-20T22:34:31.312ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
42662024-12-20T22:34:31.312ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:51151
42672024-12-20T22:34:31.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:51151 req_id = b32505b2-5dae-480e-a668-b9f2b636069f roles = RoleSet { roles: {} } uri = /metrics/producers
42682024-12-20T22:34:31.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:51151 req_id = b32505b2-5dae-480e-a668-b9f2b636069f resource = Database result = Ok(()) uri = /metrics/producers
42692024-12-20T22:34:31.360ZINFOnexus: assigned collector to new producer collector_id = a0c68cf7-84ce-4a59-a3f9-ff7d332963b9 file = nexus/src/app/oximeter.rs:76 producer_id = c08fb79e-9df2-49bb-be41-3925df103e75
42702024-12-20T22:34:31.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47830 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:51151 req_id = b32505b2-5dae-480e-a668-b9f2b636069f response_code = 201 uri = /metrics/producers
42712024-12-20T22:34:31.360ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "b32505b2-5dae-480e-a668-b9f2b636069f", "content-length": "41", "date": "Fri, 20 Dec 2024 22:34:31 GMT"} })
42722024-12-20T22:34:31.361ZDEBGnexus (producer-registration-task): registered with nexus successfully
42732024-12-20T22:34:31.361ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
42742024-12-20T22:34:32.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c103e010-7557-4766-a84b-df350e991f6b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
42752024-12-20T22:34:32.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c103e010-7557-4766-a84b-df350e991f6b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
42762024-12-20T22:34:32.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c103e010-7557-4766-a84b-df350e991f6b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
42772024-12-20T22:34:33.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b68f320a-831b-444a-a350-9f505e33fb37 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
42782024-12-20T22:34:33.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b68f320a-831b-444a-a350-9f505e33fb37 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
42792024-12-20T22:34:33.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b68f320a-831b-444a-a350-9f505e33fb37 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
42802024-12-20T22:34:34.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8b69be0d-d145-4ec6-b286-3e1c107b68b4 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
42812024-12-20T22:34:34.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8b69be0d-d145-4ec6-b286-3e1c107b68b4 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
42822024-12-20T22:34:34.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2705 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8b69be0d-d145-4ec6-b286-3e1c107b68b4 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
42832024-12-20T22:34:35.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = faa8ae85-cec4-4b4a-9f88-4aa3947addeb roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
42842024-12-20T22:34:35.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = faa8ae85-cec4-4b4a-9f88-4aa3947addeb resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
42852024-12-20T22:34:35.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2496 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = faa8ae85-cec4-4b4a-9f88-4aa3947addeb response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
42862024-12-20T22:34:35.320ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:64780
42872024-12-20T22:34:35.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 5085459f-0989-43e3-8952-733b305c66c5 roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
42882024-12-20T22:34:35.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 5085459f-0989-43e3-8952-733b305c66c5 resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
42892024-12-20T22:34:35.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 5085459f-0989-43e3-8952-733b305c66c5 response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
42902024-12-20T22:34:35.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = e39942e9-bfdb-4619-8b6d-964ed83392ec roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
42912024-12-20T22:34:35.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = e39942e9-bfdb-4619-8b6d-964ed83392ec resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
42922024-12-20T22:34:35.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2511 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = e39942e9-bfdb-4619-8b6d-964ed83392ec response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
42932024-12-20T22:34:35.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 529 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = a4517cf1-77b2-425c-bb3a-2b57660170a8 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
42942024-12-20T22:34:36.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1bb0696b-770c-4aba-88b7-124256634e96 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
42952024-12-20T22:34:36.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1bb0696b-770c-4aba-88b7-124256634e96 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
42962024-12-20T22:34:36.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1bb0696b-770c-4aba-88b7-124256634e96 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
42972024-12-20T22:34:37.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ce26ea49-8fda-4d0f-9f34-7c56825870f2 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
42982024-12-20T22:34:37.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ce26ea49-8fda-4d0f-9f34-7c56825870f2 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
42992024-12-20T22:34:37.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ce26ea49-8fda-4d0f-9f34-7c56825870f2 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43002024-12-20T22:34:38.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4f46c232-7f4b-441b-9666-953e61f0a6c1 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43012024-12-20T22:34:38.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4f46c232-7f4b-441b-9666-953e61f0a6c1 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43022024-12-20T22:34:38.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4f46c232-7f4b-441b-9666-953e61f0a6c1 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43032024-12-20T22:34:39.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 37d4c9d2-0a15-4e88-bcdb-9f5ce23bae0b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43042024-12-20T22:34:39.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 37d4c9d2-0a15-4e88-bcdb-9f5ce23bae0b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43052024-12-20T22:34:39.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 37d4c9d2-0a15-4e88-bcdb-9f5ce23bae0b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43062024-12-20T22:34:40.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b374f394-18d6-4a4d-8a92-1be5c800b74a roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43072024-12-20T22:34:40.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b374f394-18d6-4a4d-8a92-1be5c800b74a resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43082024-12-20T22:34:40.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1965 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b374f394-18d6-4a4d-8a92-1be5c800b74a response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43092024-12-20T22:34:40.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
43102024-12-20T22:34:40.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43112024-12-20T22:34:40.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43122024-12-20T22:34:40.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
43132024-12-20T22:34:40.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43142024-12-20T22:34:40.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43152024-12-20T22:34:40.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43162024-12-20T22:34:40.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43172024-12-20T22:34:40.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43182024-12-20T22:34:40.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43192024-12-20T22:34:40.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43202024-12-20T22:34:40.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43212024-12-20T22:34:40.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43222024-12-20T22:34:40.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
43232024-12-20T22:34:40.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43242024-12-20T22:34:40.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43252024-12-20T22:34:40.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
43262024-12-20T22:34:40.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.146587ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
43272024-12-20T22:34:40.615ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43282024-12-20T22:34:40.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43292024-12-20T22:34:40.616ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.618933ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43302024-12-20T22:34:41.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1de6b9e1-d0b3-480e-afe3-5b7679515c56 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43312024-12-20T22:34:41.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1de6b9e1-d0b3-480e-afe3-5b7679515c56 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43322024-12-20T22:34:41.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2586 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1de6b9e1-d0b3-480e-afe3-5b7679515c56 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43332024-12-20T22:34:42.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0b3d20bc-1a1d-456b-9756-fe9e193557c5 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43342024-12-20T22:34:42.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0b3d20bc-1a1d-456b-9756-fe9e193557c5 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43352024-12-20T22:34:42.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0b3d20bc-1a1d-456b-9756-fe9e193557c5 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43362024-12-20T22:34:43.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c3db5d48-14ad-429f-8049-992fc7a122c7 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43372024-12-20T22:34:43.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c3db5d48-14ad-429f-8049-992fc7a122c7 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43382024-12-20T22:34:43.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1728 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c3db5d48-14ad-429f-8049-992fc7a122c7 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43392024-12-20T22:34:44.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fac8395d-182b-4248-93b2-c3fd1a4ed015 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43402024-12-20T22:34:44.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fac8395d-182b-4248-93b2-c3fd1a4ed015 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43412024-12-20T22:34:44.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fac8395d-182b-4248-93b2-c3fd1a4ed015 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43422024-12-20T22:34:45.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 658 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 9091d9a7-6c71-4985-8d62-c8dc2d960b17 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
43432024-12-20T22:34:45.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3a9ce519-e8e5-443d-889d-9ee85495c155 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43442024-12-20T22:34:45.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3a9ce519-e8e5-443d-889d-9ee85495c155 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43452024-12-20T22:34:45.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1632 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3a9ce519-e8e5-443d-889d-9ee85495c155 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43462024-12-20T22:34:46.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 988dc0b0-30f0-424a-91fe-b0c89f05cda8 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43472024-12-20T22:34:46.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 988dc0b0-30f0-424a-91fe-b0c89f05cda8 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43482024-12-20T22:34:46.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 988dc0b0-30f0-424a-91fe-b0c89f05cda8 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43492024-12-20T22:34:47.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c558df41-048a-452f-b94c-bedd3e82b406 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43502024-12-20T22:34:47.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c558df41-048a-452f-b94c-bedd3e82b406 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43512024-12-20T22:34:47.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c558df41-048a-452f-b94c-bedd3e82b406 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43522024-12-20T22:34:48.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5dd1fba3-227f-4fb9-80ce-49419c9f4379 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43532024-12-20T22:34:48.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5dd1fba3-227f-4fb9-80ce-49419c9f4379 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43542024-12-20T22:34:48.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5dd1fba3-227f-4fb9-80ce-49419c9f4379 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43552024-12-20T22:34:49.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b0893327-a9e8-434b-82ce-8783755984b0 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43562024-12-20T22:34:49.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b0893327-a9e8-434b-82ce-8783755984b0 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43572024-12-20T22:34:49.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b0893327-a9e8-434b-82ce-8783755984b0 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43582024-12-20T22:34:50.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
43592024-12-20T22:34:50.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43602024-12-20T22:34:50.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43612024-12-20T22:34:50.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
43622024-12-20T22:34:50.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43632024-12-20T22:34:50.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43642024-12-20T22:34:50.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43652024-12-20T22:34:50.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43662024-12-20T22:34:50.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43672024-12-20T22:34:50.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43682024-12-20T22:34:50.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43692024-12-20T22:34:50.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43702024-12-20T22:34:50.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43712024-12-20T22:34:50.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43722024-12-20T22:34:50.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43732024-12-20T22:34:50.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
43742024-12-20T22:34:50.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43752024-12-20T22:34:50.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43762024-12-20T22:34:50.594ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
43772024-12-20T22:34:50.594ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.1417ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
43782024-12-20T22:34:50.618ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 45.019452ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43792024-12-20T22:34:50.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 86b252fe-90ca-4bfc-a01a-e6e90be8a7de roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43802024-12-20T22:34:50.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 86b252fe-90ca-4bfc-a01a-e6e90be8a7de resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43812024-12-20T22:34:50.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 86b252fe-90ca-4bfc-a01a-e6e90be8a7de response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43822024-12-20T22:34:51.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9ba4751b-6762-4736-9062-db04dc245a82 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43832024-12-20T22:34:51.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9ba4751b-6762-4736-9062-db04dc245a82 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43842024-12-20T22:34:51.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9ba4751b-6762-4736-9062-db04dc245a82 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43852024-12-20T22:34:52.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 60ad985d-f676-4c57-a912-71ed39575cbf roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43862024-12-20T22:34:52.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 60ad985d-f676-4c57-a912-71ed39575cbf resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43872024-12-20T22:34:52.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2475 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 60ad985d-f676-4c57-a912-71ed39575cbf response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43882024-12-20T22:34:53.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ec5f05e8-8664-48db-b2da-3c9d490e0f66 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43892024-12-20T22:34:53.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ec5f05e8-8664-48db-b2da-3c9d490e0f66 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43902024-12-20T22:34:53.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ec5f05e8-8664-48db-b2da-3c9d490e0f66 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43912024-12-20T22:34:54.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6af02956-438c-4538-ac07-46797ce30a5b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43922024-12-20T22:34:54.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6af02956-438c-4538-ac07-46797ce30a5b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43932024-12-20T22:34:54.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6af02956-438c-4538-ac07-46797ce30a5b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43942024-12-20T22:34:55.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 528 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 8efef9a8-6254-4322-a5d3-ec482254be14 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
43952024-12-20T22:34:55.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cb706f79-c991-4dd9-a5cc-f25d537ceb73 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43962024-12-20T22:34:55.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cb706f79-c991-4dd9-a5cc-f25d537ceb73 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43972024-12-20T22:34:55.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cb706f79-c991-4dd9-a5cc-f25d537ceb73 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43982024-12-20T22:34:56.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 64ed4443-b109-4fdc-8d71-363a5963b000 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
43992024-12-20T22:34:56.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 64ed4443-b109-4fdc-8d71-363a5963b000 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
44002024-12-20T22:34:56.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 64ed4443-b109-4fdc-8d71-363a5963b000 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
44012024-12-20T22:34:57.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19893091-8762-4e84-98a8-b822fc9dd8af roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
44022024-12-20T22:34:57.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19893091-8762-4e84-98a8-b822fc9dd8af resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
44032024-12-20T22:34:57.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19893091-8762-4e84-98a8-b822fc9dd8af response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
44042024-12-20T22:34:58.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 69010b9c-15ec-4960-9ee1-4d2f5bba8b20 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
44052024-12-20T22:34:58.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 69010b9c-15ec-4960-9ee1-4d2f5bba8b20 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
44062024-12-20T22:34:58.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 69010b9c-15ec-4960-9ee1-4d2f5bba8b20 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
44072024-12-20T22:34:59.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c93fad48-8ac0-49ac-865f-741c09984dfc roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
44082024-12-20T22:34:59.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c93fad48-8ac0-49ac-865f-741c09984dfc resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
44092024-12-20T22:34:59.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c93fad48-8ac0-49ac-865f-741c09984dfc response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
44102024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
44112024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44122024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
44132024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
44142024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
44152024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
44162024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
44172024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
44182024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
44192024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44202024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
44212024-12-20T22:35:00.571ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:25:00.571348404 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
44222024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
44232024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
44242024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
44252024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
44262024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44272024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
44282024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
44292024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44302024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
44312024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44322024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
44332024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
44342024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
44352024-12-20T22:35:00.571ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e
44362024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44372024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44382024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44392024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.12\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e"}
44402024-12-20T22:35:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44412024-12-20T22:35:00.571ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bcf7579-f08c-458a-b8fa-486beafab77e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c65750e1-e505-4d05-b242-145c69974016.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c65750e1-e505-4d05-b242-145c69974016.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1248, tv_nsec: 184472553 } })
44422024-12-20T22:35:00.571ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b172144-6fe3-403a-b88e-6be93db6788c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e1e925bb-4266-49d2-b532-0f79860badbb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9d7e78a-d944-4f23-9be0-86e0f1334a43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9d7e78a-d944-4f23-9be0-86e0f1334a43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1248, tv_nsec: 184473943 } })
44432024-12-20T22:35:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44442024-12-20T22:35:00.572ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
44452024-12-20T22:35:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.08221ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
44462024-12-20T22:35:00.572ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
44472024-12-20T22:35:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.210353ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
44482024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
44492024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
44502024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
44512024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
44522024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44532024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
44542024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44552024-12-20T22:35:00.573ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
44562024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
44572024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
44582024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
44592024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44602024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
44612024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
44622024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44632024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
44642024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44652024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
44662024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
44672024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
44682024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
44692024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44702024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
44712024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
44722024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44732024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44742024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
44752024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44762024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
44772024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
44782024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
44792024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44802024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
44812024-12-20T22:35:00.573ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
44822024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44832024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
44842024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
44852024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
44862024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44872024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44882024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
44892024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
44902024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44912024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44922024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44932024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44942024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44952024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
44962024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44972024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44982024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44992024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
45002024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45012024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
45022024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45032024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45042024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
45052024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45062024-12-20T22:35:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45072024-12-20T22:35:00.574ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45082024-12-20T22:35:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45092024-12-20T22:35:00.574ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45102024-12-20T22:35:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45112024-12-20T22:35:00.574ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45122024-12-20T22:35:00.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45132024-12-20T22:35:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45142024-12-20T22:35:00.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1248, tv_nsec: 187141806 } })
45152024-12-20T22:35:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45162024-12-20T22:35:00.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
45172024-12-20T22:35:00.575ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1248, tv_nsec: 187642930 } })
45182024-12-20T22:35:00.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45192024-12-20T22:35:00.575ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
45202024-12-20T22:35:00.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45212024-12-20T22:35:00.575ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:25:00.571348404 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
45222024-12-20T22:35:00.575ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.35518ms iteration = 10 status = {"expiration":"2024-12-20T22:25:00.571348404Z","pruned":[]}
45232024-12-20T22:35:00.575ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.482334ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
45242024-12-20T22:35:00.575ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45252024-12-20T22:35:00.577ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
45262024-12-20T22:35:00.577ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45272024-12-20T22:35:00.577ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45282024-12-20T22:35:00.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45292024-12-20T22:35:00.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45302024-12-20T22:35:00.579ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45312024-12-20T22:35:00.579ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45322024-12-20T22:35:00.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45332024-12-20T22:35:00.581ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45342024-12-20T22:35:00.581ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
45352024-12-20T22:35:00.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45362024-12-20T22:35:00.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45372024-12-20T22:35:00.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
45382024-12-20T22:35:00.582ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
45392024-12-20T22:35:00.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
45402024-12-20T22:35:00.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
45412024-12-20T22:35:00.582ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45422024-12-20T22:35:00.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45432024-12-20T22:35:00.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
45442024-12-20T22:35:00.584ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45452024-12-20T22:35:00.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45462024-12-20T22:35:00.584ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45472024-12-20T22:35:00.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
45482024-12-20T22:35:00.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45492024-12-20T22:35:00.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45502024-12-20T22:35:00.589ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.734465ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
45512024-12-20T22:35:00.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45522024-12-20T22:35:00.591ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45532024-12-20T22:35:00.592ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45542024-12-20T22:35:00.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45552024-12-20T22:35:00.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45562024-12-20T22:35:00.594ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45572024-12-20T22:35:00.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
45582024-12-20T22:35:00.596ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45592024-12-20T22:35:00.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45602024-12-20T22:35:00.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
45612024-12-20T22:35:00.597ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45622024-12-20T22:35:00.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45632024-12-20T22:35:00.601ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45642024-12-20T22:35:00.601ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.221039ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45652024-12-20T22:35:00.603ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45662024-12-20T22:35:00.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45672024-12-20T22:35:00.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45682024-12-20T22:35:00.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45692024-12-20T22:35:00.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45702024-12-20T22:35:00.635ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.227447ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
45712024-12-20T22:35:00.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45722024-12-20T22:35:00.650ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45732024-12-20T22:35:00.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45742024-12-20T22:35:00.651ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45752024-12-20T22:35:00.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45762024-12-20T22:35:00.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45772024-12-20T22:35:00.654ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45782024-12-20T22:35:00.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45792024-12-20T22:35:00.657ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45802024-12-20T22:35:00.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45812024-12-20T22:35:00.660ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 86.750994ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
45822024-12-20T22:35:00.660ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1248, tv_nsec: 273301634 } })
45832024-12-20T22:35:00.661ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
45842024-12-20T22:35:00.662ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45852024-12-20T22:35:00.663ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45862024-12-20T22:35:00.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45872024-12-20T22:35:00.663ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
45882024-12-20T22:35:00.663ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
45892024-12-20T22:35:00.663ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 90.328663ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
45902024-12-20T22:35:00.663ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45912024-12-20T22:35:00.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45922024-12-20T22:35:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
45932024-12-20T22:35:00.665ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45942024-12-20T22:35:00.665ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45952024-12-20T22:35:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45962024-12-20T22:35:00.666ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
45972024-12-20T22:35:00.666ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
45982024-12-20T22:35:00.666ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 93.433508ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
45992024-12-20T22:35:00.667ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.723147ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
46002024-12-20T22:35:00.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46012024-12-20T22:35:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
46022024-12-20T22:35:00.667ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
46032024-12-20T22:35:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
46042024-12-20T22:35:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46052024-12-20T22:35:00.669ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 96.465902ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
46062024-12-20T22:35:00.670ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46072024-12-20T22:35:00.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46082024-12-20T22:35:00.671ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46092024-12-20T22:35:00.671ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
46102024-12-20T22:35:00.671ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46112024-12-20T22:35:00.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46122024-12-20T22:35:00.672ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46132024-12-20T22:35:00.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46142024-12-20T22:35:00.674ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46152024-12-20T22:35:00.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46162024-12-20T22:35:00.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46172024-12-20T22:35:00.677ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46182024-12-20T22:35:00.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
46192024-12-20T22:35:00.679ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
46202024-12-20T22:35:00.679ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
46212024-12-20T22:35:00.679ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
46222024-12-20T22:35:00.679ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46232024-12-20T22:35:00.679ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
46242024-12-20T22:35:00.679ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
46252024-12-20T22:35:00.679ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
46262024-12-20T22:35:00.679ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46272024-12-20T22:35:00.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46282024-12-20T22:35:00.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46292024-12-20T22:35:00.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
46302024-12-20T22:35:00.679ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
46312024-12-20T22:35:00.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
46322024-12-20T22:35:00.681ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46332024-12-20T22:35:00.681ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46342024-12-20T22:35:00.682ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
46352024-12-20T22:35:00.682ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 108.972127ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
46362024-12-20T22:35:00.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
46372024-12-20T22:35:00.684ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46382024-12-20T22:35:00.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46392024-12-20T22:35:00.686ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46402024-12-20T22:35:00.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46412024-12-20T22:35:00.686ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46422024-12-20T22:35:00.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46432024-12-20T22:35:00.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46442024-12-20T22:35:00.686ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46452024-12-20T22:35:00.687ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
46462024-12-20T22:35:00.687ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 0 version = 2
46472024-12-20T22:35:00.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46482024-12-20T22:35:00.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46492024-12-20T22:35:00.688ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46502024-12-20T22:35:00.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46512024-12-20T22:35:00.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
46522024-12-20T22:35:00.688ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
46532024-12-20T22:35:00.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
46542024-12-20T22:35:00.690ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46552024-12-20T22:35:00.690ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
46562024-12-20T22:35:00.691ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46572024-12-20T22:35:00.691ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 118.151931ms iteration = 5 status = {"nsuccess":5}
46582024-12-20T22:35:00.694ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
46592024-12-20T22:35:00.694ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46602024-12-20T22:35:00.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46612024-12-20T22:35:00.695ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
46622024-12-20T22:35:00.695ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46632024-12-20T22:35:00.695ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
46642024-12-20T22:35:00.696ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46652024-12-20T22:35:00.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46662024-12-20T22:35:00.696ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "acf6a628-f429-4bc6-b2c1-d8f109cf6d98", "content-length": "26", "date": "Fri, 20 Dec 2024 22:35:00 GMT"} })
46672024-12-20T22:35:00.696ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46682024-12-20T22:35:00.697ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 1 version = 2
46692024-12-20T22:35:00.697ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
46702024-12-20T22:35:00.697ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:26:40.428768 UTC dns_group = external generation = 2
46712024-12-20T22:35:00.697ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 126.481591ms iteration = 10 status = {"generation":2}
46722024-12-20T22:35:00.698ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
46732024-12-20T22:35:00.701ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46742024-12-20T22:35:00.702ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
46752024-12-20T22:35:00.702ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46762024-12-20T22:35:00.704ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "862e5a5e-8d87-4080-837c-3479a8dfb27b", "content-length": "26", "date": "Fri, 20 Dec 2024 22:35:00 GMT"} })
46772024-12-20T22:35:00.704ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46782024-12-20T22:35:00.706ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 131.853409ms iteration = 19 status = 0
46792024-12-20T22:35:00.708ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46802024-12-20T22:35:00.717ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46812024-12-20T22:35:00.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = f0440539-c86f-4705-8f93-38aac26a27f5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
46822024-12-20T22:35:00.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = f0440539-c86f-4705-8f93-38aac26a27f5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
46832024-12-20T22:35:00.719ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46842024-12-20T22:35:00.720ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46852024-12-20T22:35:00.720ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46862024-12-20T22:35:00.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46872024-12-20T22:35:00.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46882024-12-20T22:35:00.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = f0440539-c86f-4705-8f93-38aac26a27f5 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
46892024-12-20T22:35:00.723ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 149.565228ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
46902024-12-20T22:35:00.725ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46912024-12-20T22:35:00.725ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
46922024-12-20T22:35:00.725ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 151.981904ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
46932024-12-20T22:35:00.728ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
46942024-12-20T22:35:00.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
46952024-12-20T22:35:00.733ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46962024-12-20T22:35:00.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46972024-12-20T22:35:00.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46982024-12-20T22:35:00.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
46992024-12-20T22:35:00.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47002024-12-20T22:35:00.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47012024-12-20T22:35:00.758ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
47022024-12-20T22:35:00.758ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
47032024-12-20T22:35:00.758ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47042024-12-20T22:35:00.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47052024-12-20T22:35:00.786ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47062024-12-20T22:35:00.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47072024-12-20T22:35:00.827ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 254.328929ms iteration = 21 status = {"physical_disks_added":0}
47082024-12-20T22:35:00.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 17779cae-7fa5-4b3c-949f-32965ce3846b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
47092024-12-20T22:35:00.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 17779cae-7fa5-4b3c-949f-32965ce3846b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
47102024-12-20T22:35:00.864ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
47112024-12-20T22:35:00.864ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 290.869457ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
47122024-12-20T22:35:00.871ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
47132024-12-20T22:35:00.871ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47142024-12-20T22:35:00.871ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b05313c-f759-4118-a28e-4acd3367fdfa", "content-length": "372", "date": "Fri, 20 Dec 2024 22:35:00 GMT"} })
47152024-12-20T22:35:00.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47162024-12-20T22:35:00.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47172024-12-20T22:35:00.872ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
47182024-12-20T22:35:00.872ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7e14ccc5-ee7d-47f8-a836-f035394d205a", "date": "Fri, 20 Dec 2024 22:35:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
47192024-12-20T22:35:00.872ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
47202024-12-20T22:35:00.873ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47212024-12-20T22:35:00.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47222024-12-20T22:35:00.874ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a7f9d416-bf50-4da3-8e20-f094e96e4cf8", "date": "Fri, 20 Dec 2024 22:35:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
47232024-12-20T22:35:00.874ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
47242024-12-20T22:35:00.876ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
47252024-12-20T22:35:00.876ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47262024-12-20T22:35:00.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47272024-12-20T22:35:00.876ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
47282024-12-20T22:35:00.876ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 305.110769ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
47292024-12-20T22:35:00.876ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
47302024-12-20T22:35:00.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
47312024-12-20T22:35:00.877ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47322024-12-20T22:35:00.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47332024-12-20T22:35:00.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 17779cae-7fa5-4b3c-949f-32965ce3846b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
47342024-12-20T22:35:00.880ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
47352024-12-20T22:35:00.880ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
47362024-12-20T22:35:00.880ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:26:39.700273 UTC dns_group = internal generation = 1
47372024-12-20T22:35:00.880ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 309.493731ms iteration = 10 status = {"generation":1}
47382024-12-20T22:35:00.881ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47392024-12-20T22:35:00.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47402024-12-20T22:35:00.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47412024-12-20T22:35:00.885ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
47422024-12-20T22:35:00.885ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 314.020086ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
47432024-12-20T22:35:00.885ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47442024-12-20T22:35:00.885ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47452024-12-20T22:35:00.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47462024-12-20T22:35:00.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47472024-12-20T22:35:00.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47482024-12-20T22:35:00.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47492024-12-20T22:35:00.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47502024-12-20T22:35:00.923ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:25:57.040586Z, time_modified: 2024-12-20T22:25:57.040586Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }) }
47512024-12-20T22:35:00.923ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 352.550559ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]}},"default_endpoint":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
47522024-12-20T22:35:00.933ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
47532024-12-20T22:35:00.933ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
47542024-12-20T22:35:00.933ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f037e9fc-f8bd-45b3-8400-b548e8eb633b", "date": "Fri, 20 Dec 2024 22:35:00 GMT"} })
47552024-12-20T22:35:00.933ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47562024-12-20T22:35:00.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47572024-12-20T22:35:00.935ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47582024-12-20T22:35:00.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47592024-12-20T22:35:00.938ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47602024-12-20T22:35:00.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47612024-12-20T22:35:00.942ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
47622024-12-20T22:35:00.942ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47632024-12-20T22:35:00.942ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9c9fe357-f0d5-4447-90d1-15d9cf42cb3a", "date": "Fri, 20 Dec 2024 22:35:00 GMT"} })
47642024-12-20T22:35:00.944ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 370.818973ms iteration = 19 status = {}
47652024-12-20T22:35:00.945ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 zone_address = fd00:1122:3344:101::2
47662024-12-20T22:35:00.945ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47672024-12-20T22:35:00.946ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7f6375d-6d60-4728-9b95-0cea5242b3f4", "content-length": "26", "date": "Fri, 20 Dec 2024 22:35:00 GMT"} })
47682024-12-20T22:35:00.946ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47692024-12-20T22:35:00.948ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
47702024-12-20T22:35:01.019ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
47712024-12-20T22:35:01.019ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "bc2301c4-6873-4a34-befd-951ff04431fd", "date": "Fri, 20 Dec 2024 22:35:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
47722024-12-20T22:35:01.019ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
47732024-12-20T22:35:01.021ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2008e8cc-b0ca-4681-ae15-00817d12a3fa", "date": "Fri, 20 Dec 2024 22:35:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
47742024-12-20T22:35:01.021ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
47752024-12-20T22:35:01.023ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6884d7d7-75df-4156-8f9b-e37673ad8523", "date": "Fri, 20 Dec 2024 22:35:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
47762024-12-20T22:35:01.023ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
47772024-12-20T22:35:01.025ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
47782024-12-20T22:35:01.025ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 453.837814ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
47792024-12-20T22:35:01.034ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
47802024-12-20T22:35:01.034ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b0be44d-a867-468b-b8c6-15b10a698757", "content-length": "691", "date": "Fri, 20 Dec 2024 22:35:00 GMT"} })
47812024-12-20T22:35:01.034ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
47822024-12-20T22:35:01.034ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
47832024-12-20T22:35:01.034ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
47842024-12-20T22:35:01.036ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 463.397258ms iteration = 19 status = {}
47852024-12-20T22:35:01.037ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 466.580446ms iteration = 19 status = {}
47862024-12-20T22:35:01.044ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
47872024-12-20T22:35:01.044ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "305fe661-8b15-4bac-8b13-8bfd37d4c84d", "content-length": "1", "date": "Fri, 20 Dec 2024 22:35:00 GMT"} })
47882024-12-20T22:35:01.046ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47892024-12-20T22:35:01.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47902024-12-20T22:35:01.048ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 477.043114ms iteration = 19 status = null
47912024-12-20T22:35:01.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47922024-12-20T22:35:01.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47932024-12-20T22:35:01.116ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9fedf0d4-8a86-4506-bf93-224faabd5e37, rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b26f0563-25fb-4d7c-8480-dd368ac01105) } rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
47942024-12-20T22:35:01.116ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47952024-12-20T22:35:01.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47962024-12-20T22:35:01.127ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
47972024-12-20T22:35:01.127ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8a1463c-b983-4c0e-919c-6617c03eb9a4", "content-length": "134", "date": "Fri, 20 Dec 2024 22:35:00 GMT"} })
47982024-12-20T22:35:01.127ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
47992024-12-20T22:35:01.127ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b26f0563-25fb-4d7c-8480-dd368ac01105
48002024-12-20T22:35:01.127ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
48012024-12-20T22:35:01.127ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48022024-12-20T22:35:01.127ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48032024-12-20T22:35:01.127ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48042024-12-20T22:35:01.127ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48052024-12-20T22:35:01.127ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48062024-12-20T22:35:01.128ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48072024-12-20T22:35:01.128ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48082024-12-20T22:35:01.128ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
48092024-12-20T22:35:01.128ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48102024-12-20T22:35:01.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48112024-12-20T22:35:01.130ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
48122024-12-20T22:35:01.130ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3af7c306-130f-44dd-8a07-1a146df718ee", "content-length": "2", "date": "Fri, 20 Dec 2024 22:35:00 GMT"} })
48132024-12-20T22:35:01.130ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
48142024-12-20T22:35:01.130ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "510a0d04-2423-4936-8b92-7061df300039", "content-length": "52", "date": "Fri, 20 Dec 2024 22:35:00 GMT"} })
48152024-12-20T22:35:01.130ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
48162024-12-20T22:35:01.130ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
48172024-12-20T22:35:01.226ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "eec96273-b885-450c-bc68-e48232816efb", "date": "Fri, 20 Dec 2024 22:35:01 GMT"} })
48182024-12-20T22:35:01.226ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch = Switch0
48192024-12-20T22:35:01.226ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48202024-12-20T22:35:01.226ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "025ea42e-8f43-43d7-9d3e-cd849c422ff5", "content-length": "682", "date": "Fri, 20 Dec 2024 22:35:01 GMT"} })
48212024-12-20T22:35:01.226ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48222024-12-20T22:35:01.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48232024-12-20T22:35:01.230ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48242024-12-20T22:35:01.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48252024-12-20T22:35:01.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48262024-12-20T22:35:01.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48272024-12-20T22:35:01.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48282024-12-20T22:35:01.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48292024-12-20T22:35:01.244ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 670.813702ms iteration = 19 status = {}
48302024-12-20T22:35:01.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6a8baa8e-9f2a-4744-842a-f234b0ee12d6 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48312024-12-20T22:35:01.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6a8baa8e-9f2a-4744-842a-f234b0ee12d6 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48322024-12-20T22:35:01.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6a8baa8e-9f2a-4744-842a-f234b0ee12d6 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48332024-12-20T22:35:02.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e7da16d8-640f-4169-b81d-f6f36c6fdb48 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48342024-12-20T22:35:02.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e7da16d8-640f-4169-b81d-f6f36c6fdb48 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48352024-12-20T22:35:02.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1760 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e7da16d8-640f-4169-b81d-f6f36c6fdb48 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48362024-12-20T22:35:03.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4219f14e-f122-4245-9266-3755d6330022 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48372024-12-20T22:35:03.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4219f14e-f122-4245-9266-3755d6330022 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48382024-12-20T22:35:03.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4219f14e-f122-4245-9266-3755d6330022 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48392024-12-20T22:35:04.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4a0f1e8a-a4f2-4b7b-bd14-d89236922ad3 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48402024-12-20T22:35:04.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4a0f1e8a-a4f2-4b7b-bd14-d89236922ad3 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48412024-12-20T22:35:04.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4a0f1e8a-a4f2-4b7b-bd14-d89236922ad3 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48422024-12-20T22:35:05.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 1680746a-3296-4d58-a307-2a774221a8f0 roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
48432024-12-20T22:35:05.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 1680746a-3296-4d58-a307-2a774221a8f0 resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
48442024-12-20T22:35:05.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2608 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 1680746a-3296-4d58-a307-2a774221a8f0 response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
48452024-12-20T22:35:05.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 297fc7fe-cf1d-40ee-aafb-e1db89a5ab69 roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
48462024-12-20T22:35:05.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 297fc7fe-cf1d-40ee-aafb-e1db89a5ab69 resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
48472024-12-20T22:35:05.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 297fc7fe-cf1d-40ee-aafb-e1db89a5ab69 response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
48482024-12-20T22:35:05.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 594 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 16f2cab8-cf38-4e5d-af7a-00e8a38327fb response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
48492024-12-20T22:35:05.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 28838cad-92ab-4d17-83f4-d821ea4d4fa8 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48502024-12-20T22:35:05.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 28838cad-92ab-4d17-83f4-d821ea4d4fa8 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48512024-12-20T22:35:05.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 28838cad-92ab-4d17-83f4-d821ea4d4fa8 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48522024-12-20T22:35:07.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c5ce191c-a5a1-4bdb-a74c-ea2849d203a0 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48532024-12-20T22:35:07.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c5ce191c-a5a1-4bdb-a74c-ea2849d203a0 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48542024-12-20T22:35:07.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c5ce191c-a5a1-4bdb-a74c-ea2849d203a0 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48552024-12-20T22:35:08.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8a8d7ddd-5b62-4c66-baaf-068be2c65ae9 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48562024-12-20T22:35:08.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8a8d7ddd-5b62-4c66-baaf-068be2c65ae9 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48572024-12-20T22:35:08.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8a8d7ddd-5b62-4c66-baaf-068be2c65ae9 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48582024-12-20T22:35:09.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5df1edc2-dbed-43b8-86ec-12eb31b99da8 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48592024-12-20T22:35:09.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5df1edc2-dbed-43b8-86ec-12eb31b99da8 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48602024-12-20T22:35:09.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5df1edc2-dbed-43b8-86ec-12eb31b99da8 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48612024-12-20T22:35:10.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 27a8d937-7d40-437b-8d78-8d1f3c3c0e76 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48622024-12-20T22:35:10.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 27a8d937-7d40-437b-8d78-8d1f3c3c0e76 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48632024-12-20T22:35:10.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 27a8d937-7d40-437b-8d78-8d1f3c3c0e76 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48642024-12-20T22:35:10.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
48652024-12-20T22:35:10.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48662024-12-20T22:35:10.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48672024-12-20T22:35:10.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
48682024-12-20T22:35:10.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48692024-12-20T22:35:10.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48702024-12-20T22:35:10.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48712024-12-20T22:35:10.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48722024-12-20T22:35:10.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48732024-12-20T22:35:10.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.829646ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48742024-12-20T22:35:10.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48752024-12-20T22:35:10.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48762024-12-20T22:35:10.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48772024-12-20T22:35:10.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48782024-12-20T22:35:10.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48792024-12-20T22:35:10.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48802024-12-20T22:35:10.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
48812024-12-20T22:35:10.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48822024-12-20T22:35:10.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48832024-12-20T22:35:10.593ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
48842024-12-20T22:35:10.593ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.846075ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
48852024-12-20T22:35:11.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 454dcdee-dc43-498f-90dc-0635fb9fdda1 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48862024-12-20T22:35:11.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 454dcdee-dc43-498f-90dc-0635fb9fdda1 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48872024-12-20T22:35:11.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 454dcdee-dc43-498f-90dc-0635fb9fdda1 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48882024-12-20T22:35:12.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 165e7e9b-2702-4177-be7e-b1f3570145d2 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48892024-12-20T22:35:12.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 165e7e9b-2702-4177-be7e-b1f3570145d2 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48902024-12-20T22:35:12.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 165e7e9b-2702-4177-be7e-b1f3570145d2 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48912024-12-20T22:35:13.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 42bbd643-b113-4829-9c41-030bf5f3c69c roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48922024-12-20T22:35:13.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 42bbd643-b113-4829-9c41-030bf5f3c69c resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48932024-12-20T22:35:13.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 42bbd643-b113-4829-9c41-030bf5f3c69c response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48942024-12-20T22:35:14.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d1850955-19c3-4c9e-896f-1ca22481915b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48952024-12-20T22:35:14.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d1850955-19c3-4c9e-896f-1ca22481915b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48962024-12-20T22:35:14.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d1850955-19c3-4c9e-896f-1ca22481915b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48972024-12-20T22:35:15.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7f931e86-9849-4e1f-a1b1-f228816c9037 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48982024-12-20T22:35:15.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7f931e86-9849-4e1f-a1b1-f228816c9037 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
48992024-12-20T22:35:15.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2016 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7f931e86-9849-4e1f-a1b1-f228816c9037 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49002024-12-20T22:35:15.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 520 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 9abd3316-0666-4ac3-b5ce-e23e3be969ed response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
49012024-12-20T22:35:16.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c90659a9-e5fd-42dd-b402-7c414da94936 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49022024-12-20T22:35:16.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c90659a9-e5fd-42dd-b402-7c414da94936 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49032024-12-20T22:35:16.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2711 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c90659a9-e5fd-42dd-b402-7c414da94936 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49042024-12-20T22:35:17.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0e1d1533-480e-48fb-a379-f4187a40b079 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49052024-12-20T22:35:17.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0e1d1533-480e-48fb-a379-f4187a40b079 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49062024-12-20T22:35:17.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0e1d1533-480e-48fb-a379-f4187a40b079 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49072024-12-20T22:35:18.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4af905ac-25d9-4346-8f74-cd8a1f1a63f5 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49082024-12-20T22:35:18.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4af905ac-25d9-4346-8f74-cd8a1f1a63f5 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49092024-12-20T22:35:18.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2114 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4af905ac-25d9-4346-8f74-cd8a1f1a63f5 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49102024-12-20T22:35:19.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 104cee26-729a-4167-8edd-6cd886728b13 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49112024-12-20T22:35:19.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 104cee26-729a-4167-8edd-6cd886728b13 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49122024-12-20T22:35:19.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 104cee26-729a-4167-8edd-6cd886728b13 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49132024-12-20T22:35:20.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9408b4a0-1870-4f97-8a27-03f942e21322 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49142024-12-20T22:35:20.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9408b4a0-1870-4f97-8a27-03f942e21322 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49152024-12-20T22:35:20.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1531 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9408b4a0-1870-4f97-8a27-03f942e21322 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49162024-12-20T22:35:20.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 0db232c6-8e8b-4f3d-89bb-91a92da511c6 roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
49172024-12-20T22:35:20.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 0db232c6-8e8b-4f3d-89bb-91a92da511c6 resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
49182024-12-20T22:35:20.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 0db232c6-8e8b-4f3d-89bb-91a92da511c6 response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
49192024-12-20T22:35:20.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 780cf13f-4037-43c4-bb10-43194d3da1f8 roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
49202024-12-20T22:35:20.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 780cf13f-4037-43c4-bb10-43194d3da1f8 resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
49212024-12-20T22:35:20.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2635 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 780cf13f-4037-43c4-bb10-43194d3da1f8 response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
49222024-12-20T22:35:20.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
49232024-12-20T22:35:20.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49242024-12-20T22:35:20.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49252024-12-20T22:35:20.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
49262024-12-20T22:35:20.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49272024-12-20T22:35:20.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49282024-12-20T22:35:20.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49292024-12-20T22:35:20.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49302024-12-20T22:35:20.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49312024-12-20T22:35:20.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49322024-12-20T22:35:20.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49332024-12-20T22:35:20.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49342024-12-20T22:35:20.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49352024-12-20T22:35:20.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
49362024-12-20T22:35:20.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49372024-12-20T22:35:20.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49382024-12-20T22:35:20.592ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
49392024-12-20T22:35:20.592ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.284582ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
49402024-12-20T22:35:20.614ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49412024-12-20T22:35:20.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49422024-12-20T22:35:20.652ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 79.307199ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49432024-12-20T22:35:21.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 78d380cf-07e6-418c-8e6c-f4fe9858ab62 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49442024-12-20T22:35:21.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 78d380cf-07e6-418c-8e6c-f4fe9858ab62 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49452024-12-20T22:35:21.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 78d380cf-07e6-418c-8e6c-f4fe9858ab62 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49462024-12-20T22:35:22.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 42d1d132-ae4d-42d4-8069-0c862a4cf718 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49472024-12-20T22:35:22.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 42d1d132-ae4d-42d4-8069-0c862a4cf718 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49482024-12-20T22:35:22.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1624 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 42d1d132-ae4d-42d4-8069-0c862a4cf718 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49492024-12-20T22:35:23.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6e9b2f67-42e7-4b7d-9d26-ee380502669d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49502024-12-20T22:35:23.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6e9b2f67-42e7-4b7d-9d26-ee380502669d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49512024-12-20T22:35:23.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6e9b2f67-42e7-4b7d-9d26-ee380502669d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49522024-12-20T22:35:24.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 57bc0631-c75b-4535-9b59-d18bd6bb80f9 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49532024-12-20T22:35:24.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 57bc0631-c75b-4535-9b59-d18bd6bb80f9 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49542024-12-20T22:35:24.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 57bc0631-c75b-4535-9b59-d18bd6bb80f9 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49552024-12-20T22:35:25.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 789 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = c308347a-f610-4090-b38a-b0e078ff9da2 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
49562024-12-20T22:35:25.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 73c9f214-5b23-4a8a-bdb1-c7e1129a86c1 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49572024-12-20T22:35:25.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 73c9f214-5b23-4a8a-bdb1-c7e1129a86c1 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49582024-12-20T22:35:25.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 73c9f214-5b23-4a8a-bdb1-c7e1129a86c1 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49592024-12-20T22:35:26.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 05c9a5dc-0cde-48b3-a119-7accf12aff4c roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49602024-12-20T22:35:26.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 05c9a5dc-0cde-48b3-a119-7accf12aff4c resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49612024-12-20T22:35:26.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 05c9a5dc-0cde-48b3-a119-7accf12aff4c response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49622024-12-20T22:35:27.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 17abd4f8-c6c9-4f29-a15e-529aeca9b1d8 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49632024-12-20T22:35:27.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 17abd4f8-c6c9-4f29-a15e-529aeca9b1d8 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49642024-12-20T22:35:27.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 17abd4f8-c6c9-4f29-a15e-529aeca9b1d8 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49652024-12-20T22:35:28.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 02abf3b0-973f-457a-8237-99fe9d6f16ee roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49662024-12-20T22:35:28.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 02abf3b0-973f-457a-8237-99fe9d6f16ee resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49672024-12-20T22:35:28.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 02abf3b0-973f-457a-8237-99fe9d6f16ee response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49682024-12-20T22:35:29.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7138a205-6e4f-40f7-93c7-c679027b9018 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49692024-12-20T22:35:29.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7138a205-6e4f-40f7-93c7-c679027b9018 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49702024-12-20T22:35:29.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7138a205-6e4f-40f7-93c7-c679027b9018 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49712024-12-20T22:35:30.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7f3f1afb-e19d-48a6-879b-bc580e00ebc1 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49722024-12-20T22:35:30.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7f3f1afb-e19d-48a6-879b-bc580e00ebc1 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49732024-12-20T22:35:30.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2539 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7f3f1afb-e19d-48a6-879b-bc580e00ebc1 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
49742024-12-20T22:35:30.571ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
49752024-12-20T22:35:30.571ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
49762024-12-20T22:35:30.571ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49772024-12-20T22:35:30.571ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
49782024-12-20T22:35:30.571ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
49792024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
49802024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49812024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
49822024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49832024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49842024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
49852024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
49862024-12-20T22:35:30.572ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
49872024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49882024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
49892024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49902024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49912024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
49922024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49932024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
49942024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
49952024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49962024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
49972024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49982024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49992024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
50002024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
50012024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
50022024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50032024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50042024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
50052024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50062024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
50072024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50082024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
50092024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50102024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
50112024-12-20T22:35:30.572ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
50122024-12-20T22:35:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50132024-12-20T22:35:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50142024-12-20T22:35:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50152024-12-20T22:35:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50162024-12-20T22:35:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50172024-12-20T22:35:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50182024-12-20T22:35:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50192024-12-20T22:35:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50202024-12-20T22:35:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50212024-12-20T22:35:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50222024-12-20T22:35:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
50232024-12-20T22:35:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50242024-12-20T22:35:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
50252024-12-20T22:35:30.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1278, tv_nsec: 186806307 } })
50262024-12-20T22:35:30.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
50272024-12-20T22:35:30.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50282024-12-20T22:35:30.575ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1278, tv_nsec: 187540088 } })
50292024-12-20T22:35:30.575ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
50302024-12-20T22:35:30.575ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.870437ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
50312024-12-20T22:35:30.576ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50322024-12-20T22:35:30.576ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50332024-12-20T22:35:30.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50342024-12-20T22:35:30.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50352024-12-20T22:35:30.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50362024-12-20T22:35:30.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50372024-12-20T22:35:30.579ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50382024-12-20T22:35:30.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50392024-12-20T22:35:30.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50402024-12-20T22:35:30.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50412024-12-20T22:35:30.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50422024-12-20T22:35:30.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50432024-12-20T22:35:30.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50442024-12-20T22:35:30.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50452024-12-20T22:35:30.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
50462024-12-20T22:35:30.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50472024-12-20T22:35:30.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50482024-12-20T22:35:30.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
50492024-12-20T22:35:30.584ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50502024-12-20T22:35:30.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50512024-12-20T22:35:30.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
50522024-12-20T22:35:30.584ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50532024-12-20T22:35:30.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50542024-12-20T22:35:30.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50552024-12-20T22:35:30.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50562024-12-20T22:35:30.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50572024-12-20T22:35:30.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50582024-12-20T22:35:30.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50592024-12-20T22:35:30.588ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50602024-12-20T22:35:30.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50612024-12-20T22:35:30.589ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50622024-12-20T22:35:30.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50632024-12-20T22:35:30.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50642024-12-20T22:35:30.591ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50652024-12-20T22:35:30.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50662024-12-20T22:35:30.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50672024-12-20T22:35:30.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
50682024-12-20T22:35:30.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50692024-12-20T22:35:30.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50702024-12-20T22:35:30.596ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1278, tv_nsec: 209362940 } })
50712024-12-20T22:35:30.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50722024-12-20T22:35:30.597ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
50732024-12-20T22:35:30.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50742024-12-20T22:35:30.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50752024-12-20T22:35:30.602ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
50762024-12-20T22:35:30.602ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 29.881334ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
50772024-12-20T22:35:30.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50782024-12-20T22:35:30.608ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50792024-12-20T22:35:30.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50802024-12-20T22:35:30.621ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
50812024-12-20T22:35:30.621ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.588228ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
50822024-12-20T22:35:30.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50832024-12-20T22:35:30.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50842024-12-20T22:35:30.638ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50852024-12-20T22:35:30.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50862024-12-20T22:35:30.641ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50872024-12-20T22:35:30.641ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50882024-12-20T22:35:30.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50892024-12-20T22:35:30.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
50902024-12-20T22:35:30.644ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50912024-12-20T22:35:30.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50922024-12-20T22:35:30.645ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 72.421189ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
50932024-12-20T22:35:30.645ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 73.021615ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
50942024-12-20T22:35:30.646ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 73.788096ms iteration = 20 status = 0
50952024-12-20T22:35:30.647ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50962024-12-20T22:35:30.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50972024-12-20T22:35:30.648ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50982024-12-20T22:35:30.648ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
50992024-12-20T22:35:30.648ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51002024-12-20T22:35:30.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51012024-12-20T22:35:30.651ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51022024-12-20T22:35:30.651ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
51032024-12-20T22:35:30.651ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51042024-12-20T22:35:30.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51052024-12-20T22:35:30.654ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51062024-12-20T22:35:30.654ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
51072024-12-20T22:35:30.654ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 81.19607ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
51082024-12-20T22:35:30.657ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 84.484022ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51092024-12-20T22:35:30.662ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
51102024-12-20T22:35:30.662ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51112024-12-20T22:35:30.662ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "73a5d4f1-d55f-4fa5-8141-4af473d59195", "content-length": "26", "date": "Fri, 20 Dec 2024 22:35:30 GMT"} })
51122024-12-20T22:35:30.662ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51132024-12-20T22:35:30.664ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51142024-12-20T22:35:30.664ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51152024-12-20T22:35:30.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51162024-12-20T22:35:30.668ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
51172024-12-20T22:35:30.668ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51182024-12-20T22:35:30.668ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5366c834-9ad5-4dee-9fb0-39ef0f00854a", "content-length": "26", "date": "Fri, 20 Dec 2024 22:35:30 GMT"} })
51192024-12-20T22:35:30.668ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51202024-12-20T22:35:30.670ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51212024-12-20T22:35:30.674ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 101.683516ms iteration = 22 status = {"physical_disks_added":0}
51222024-12-20T22:35:30.695ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 123.106297ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
51232024-12-20T22:35:30.696ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 124.015562ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
51242024-12-20T22:35:30.702ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 zone_address = fd00:1122:3344:101::2
51252024-12-20T22:35:30.702ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51262024-12-20T22:35:30.703ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "84bc11a0-7a36-46a4-94d8-95c0063f7314", "content-length": "26", "date": "Fri, 20 Dec 2024 22:35:30 GMT"} })
51272024-12-20T22:35:30.703ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51282024-12-20T22:35:30.704ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
51292024-12-20T22:35:30.708ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 135.436938ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
51302024-12-20T22:35:30.740ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51312024-12-20T22:35:30.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51322024-12-20T22:35:30.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = eedc1d13-9c50-4e32-b94a-6d8af51125b1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
51332024-12-20T22:35:30.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = eedc1d13-9c50-4e32-b94a-6d8af51125b1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
51342024-12-20T22:35:30.755ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 183.848764ms iteration = 20 status = {}
51352024-12-20T22:35:30.756ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
51362024-12-20T22:35:30.756ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1612201-efe9-4365-b554-0e7dad73cf23", "content-length": "1", "date": "Fri, 20 Dec 2024 22:35:29 GMT"} })
51372024-12-20T22:35:30.757ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51382024-12-20T22:35:30.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51392024-12-20T22:35:30.791ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
51402024-12-20T22:35:30.791ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51412024-12-20T22:35:30.792ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed43a86f-6680-4554-a9d0-9ef45feabd1f", "content-length": "372", "date": "Fri, 20 Dec 2024 22:35:29 GMT"} })
51422024-12-20T22:35:30.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51432024-12-20T22:35:30.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51442024-12-20T22:35:30.795ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 223.328743ms iteration = 20 status = null
51452024-12-20T22:35:30.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = eedc1d13-9c50-4e32-b94a-6d8af51125b1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
51462024-12-20T22:35:30.799ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51472024-12-20T22:35:30.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51482024-12-20T22:35:30.800ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51492024-12-20T22:35:30.802ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51502024-12-20T22:35:30.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51512024-12-20T22:35:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51522024-12-20T22:35:30.804ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51532024-12-20T22:35:30.806ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51542024-12-20T22:35:30.806ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51552024-12-20T22:35:30.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51562024-12-20T22:35:30.845ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
51572024-12-20T22:35:30.845ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
51582024-12-20T22:35:30.845ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ba62d8dd-e2d6-4f67-88aa-7cbd2c2ec691", "date": "Fri, 20 Dec 2024 22:35:29 GMT"} })
51592024-12-20T22:35:30.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51602024-12-20T22:35:30.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51612024-12-20T22:35:30.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51622024-12-20T22:35:30.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51632024-12-20T22:35:30.867ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
51642024-12-20T22:35:30.868ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ba2e592-3a18-485f-b557-167a1823208a", "content-length": "691", "date": "Fri, 20 Dec 2024 22:35:29 GMT"} })
51652024-12-20T22:35:30.868ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
51662024-12-20T22:35:30.868ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
51672024-12-20T22:35:30.868ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
51682024-12-20T22:35:30.869ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 296.998626ms iteration = 20 status = {}
51692024-12-20T22:35:30.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51702024-12-20T22:35:30.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51712024-12-20T22:35:30.874ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
51722024-12-20T22:35:30.874ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51732024-12-20T22:35:30.874ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "44ec5933-28cc-49ea-8bf6-d23f857a9944", "date": "Fri, 20 Dec 2024 22:35:29 GMT"} })
51742024-12-20T22:35:30.875ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51752024-12-20T22:35:30.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51762024-12-20T22:35:30.876ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 303.929998ms iteration = 20 status = {}
51772024-12-20T22:35:30.877ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9fedf0d4-8a86-4506-bf93-224faabd5e37, rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b26f0563-25fb-4d7c-8480-dd368ac01105) } rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
51782024-12-20T22:35:30.877ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51792024-12-20T22:35:30.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51802024-12-20T22:35:30.887ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
51812024-12-20T22:35:30.888ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ef3669e-781f-47f1-bbf8-a4a03f764f61", "content-length": "134", "date": "Fri, 20 Dec 2024 22:35:30 GMT"} })
51822024-12-20T22:35:30.888ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
51832024-12-20T22:35:30.888ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b26f0563-25fb-4d7c-8480-dd368ac01105
51842024-12-20T22:35:30.888ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
51852024-12-20T22:35:30.888ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51862024-12-20T22:35:30.888ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51872024-12-20T22:35:30.888ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51882024-12-20T22:35:30.888ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51892024-12-20T22:35:30.888ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51902024-12-20T22:35:30.888ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51912024-12-20T22:35:30.888ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51922024-12-20T22:35:30.888ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
51932024-12-20T22:35:30.888ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51942024-12-20T22:35:30.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51952024-12-20T22:35:30.890ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
51962024-12-20T22:35:30.890ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2001bede-e447-42f4-a18b-7d42ccaa6e1d", "content-length": "2", "date": "Fri, 20 Dec 2024 22:35:30 GMT"} })
51972024-12-20T22:35:30.890ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
51982024-12-20T22:35:30.891ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb2a3640-4340-4317-8039-a7783cfd883c", "content-length": "52", "date": "Fri, 20 Dec 2024 22:35:30 GMT"} })
51992024-12-20T22:35:30.891ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
52002024-12-20T22:35:30.891ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
52012024-12-20T22:35:30.985ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "054beb66-b50b-43c8-a332-ca00b484c800", "date": "Fri, 20 Dec 2024 22:35:30 GMT"} })
52022024-12-20T22:35:30.985ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch = Switch0
52032024-12-20T22:35:30.985ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
52042024-12-20T22:35:30.985ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a50d3bff-26c8-4364-838e-39611164542b", "content-length": "682", "date": "Fri, 20 Dec 2024 22:35:30 GMT"} })
52052024-12-20T22:35:30.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52062024-12-20T22:35:30.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52072024-12-20T22:35:30.990ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52082024-12-20T22:35:30.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52092024-12-20T22:35:30.992ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52102024-12-20T22:35:30.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52112024-12-20T22:35:30.995ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52122024-12-20T22:35:30.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52132024-12-20T22:35:31.002ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 429.610726ms iteration = 20 status = {}
52142024-12-20T22:35:31.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 140d7d32-d334-4ec1-852d-3b4b980b8d99 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52152024-12-20T22:35:31.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 140d7d32-d334-4ec1-852d-3b4b980b8d99 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52162024-12-20T22:35:31.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 140d7d32-d334-4ec1-852d-3b4b980b8d99 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52172024-12-20T22:35:32.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9858785d-dae3-4e1e-b934-b45cc55c9b15 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52182024-12-20T22:35:32.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9858785d-dae3-4e1e-b934-b45cc55c9b15 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52192024-12-20T22:35:32.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2660 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9858785d-dae3-4e1e-b934-b45cc55c9b15 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52202024-12-20T22:35:33.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 33174797-6de4-4005-ad03-2afc128fe41f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52212024-12-20T22:35:33.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 33174797-6de4-4005-ad03-2afc128fe41f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52222024-12-20T22:35:33.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 33174797-6de4-4005-ad03-2afc128fe41f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52232024-12-20T22:35:34.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9a0cf40d-ba8b-44d3-8b61-1946a420fe64 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52242024-12-20T22:35:34.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9a0cf40d-ba8b-44d3-8b61-1946a420fe64 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52252024-12-20T22:35:34.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9a0cf40d-ba8b-44d3-8b61-1946a420fe64 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52262024-12-20T22:35:35.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 572 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = e67c86a8-8ccc-432d-aa50-98150dff3670 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
52272024-12-20T22:35:35.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4ca18721-28b3-4039-a7bd-e0be13e891ad roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52282024-12-20T22:35:35.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4ca18721-28b3-4039-a7bd-e0be13e891ad resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52292024-12-20T22:35:35.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4ca18721-28b3-4039-a7bd-e0be13e891ad response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52302024-12-20T22:35:36.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 816d6722-45ee-4cdc-ac38-0e49aa0da764 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52312024-12-20T22:35:36.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 816d6722-45ee-4cdc-ac38-0e49aa0da764 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52322024-12-20T22:35:36.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2629 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 816d6722-45ee-4cdc-ac38-0e49aa0da764 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52332024-12-20T22:35:37.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 91f33c9b-679f-46b2-85a1-4d0ac0678c95 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52342024-12-20T22:35:37.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 91f33c9b-679f-46b2-85a1-4d0ac0678c95 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52352024-12-20T22:35:37.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 91f33c9b-679f-46b2-85a1-4d0ac0678c95 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52362024-12-20T22:35:38.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = bc44e3f5-e75e-4a9a-93be-8460ef61d098 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52372024-12-20T22:35:38.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = bc44e3f5-e75e-4a9a-93be-8460ef61d098 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52382024-12-20T22:35:38.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = bc44e3f5-e75e-4a9a-93be-8460ef61d098 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52392024-12-20T22:35:39.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1dde9e54-3c74-49fb-888e-cb5d8df0f679 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52402024-12-20T22:35:39.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1dde9e54-3c74-49fb-888e-cb5d8df0f679 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52412024-12-20T22:35:39.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1dde9e54-3c74-49fb-888e-cb5d8df0f679 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52422024-12-20T22:35:40.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
52432024-12-20T22:35:40.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52442024-12-20T22:35:40.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52452024-12-20T22:35:40.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
52462024-12-20T22:35:40.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52472024-12-20T22:35:40.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52482024-12-20T22:35:40.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52492024-12-20T22:35:40.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52502024-12-20T22:35:40.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52512024-12-20T22:35:40.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52522024-12-20T22:35:40.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52532024-12-20T22:35:40.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52542024-12-20T22:35:40.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52552024-12-20T22:35:40.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52562024-12-20T22:35:40.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52572024-12-20T22:35:40.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
52582024-12-20T22:35:40.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52592024-12-20T22:35:40.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52602024-12-20T22:35:40.595ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
52612024-12-20T22:35:40.595ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.042287ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
52622024-12-20T22:35:40.614ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 41.323541ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52632024-12-20T22:35:40.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4be8954f-4e06-41a3-b6bb-e9d8dbf1229a roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52642024-12-20T22:35:40.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4be8954f-4e06-41a3-b6bb-e9d8dbf1229a resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52652024-12-20T22:35:40.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4be8954f-4e06-41a3-b6bb-e9d8dbf1229a response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52662024-12-20T22:35:41.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d36de76d-e49b-4908-8ff0-fa01246f1a1f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52672024-12-20T22:35:41.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d36de76d-e49b-4908-8ff0-fa01246f1a1f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52682024-12-20T22:35:41.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d36de76d-e49b-4908-8ff0-fa01246f1a1f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52692024-12-20T22:35:42.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = dc2c5bd2-6bb5-484b-9adf-79077ef01d23 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52702024-12-20T22:35:42.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = dc2c5bd2-6bb5-484b-9adf-79077ef01d23 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52712024-12-20T22:35:42.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = dc2c5bd2-6bb5-484b-9adf-79077ef01d23 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52722024-12-20T22:35:43.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6d73a29c-cad8-4aca-b8c9-e83c8afa0d19 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52732024-12-20T22:35:43.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6d73a29c-cad8-4aca-b8c9-e83c8afa0d19 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52742024-12-20T22:35:43.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6d73a29c-cad8-4aca-b8c9-e83c8afa0d19 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52752024-12-20T22:35:44.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 73170b27-10e9-48f6-9fb3-164f5d904adc roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52762024-12-20T22:35:44.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 73170b27-10e9-48f6-9fb3-164f5d904adc resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52772024-12-20T22:35:44.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 73170b27-10e9-48f6-9fb3-164f5d904adc response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52782024-12-20T22:35:45.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 606 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 24802fb2-f0a4-4373-b620-a5e549441e4c response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
52792024-12-20T22:35:45.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9cb58c57-af69-410d-a9b2-ad857621a95d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52802024-12-20T22:35:45.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9cb58c57-af69-410d-a9b2-ad857621a95d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52812024-12-20T22:35:45.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9cb58c57-af69-410d-a9b2-ad857621a95d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52822024-12-20T22:35:46.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 670a42cc-75f7-49df-89a1-fe4196fcb0e7 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52832024-12-20T22:35:46.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 670a42cc-75f7-49df-89a1-fe4196fcb0e7 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52842024-12-20T22:35:46.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1621 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 670a42cc-75f7-49df-89a1-fe4196fcb0e7 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52852024-12-20T22:35:47.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b07d1d80-677e-46b3-9dd2-c4a98316a9b0 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52862024-12-20T22:35:47.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b07d1d80-677e-46b3-9dd2-c4a98316a9b0 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52872024-12-20T22:35:47.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b07d1d80-677e-46b3-9dd2-c4a98316a9b0 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52882024-12-20T22:35:48.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a6767863-84d1-4a65-80f2-76eed6cad4b1 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52892024-12-20T22:35:48.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a6767863-84d1-4a65-80f2-76eed6cad4b1 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52902024-12-20T22:35:48.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a6767863-84d1-4a65-80f2-76eed6cad4b1 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52912024-12-20T22:35:49.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a4be0693-bd5d-4115-9c62-ce2c2f9e418e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52922024-12-20T22:35:49.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a4be0693-bd5d-4115-9c62-ce2c2f9e418e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52932024-12-20T22:35:49.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a4be0693-bd5d-4115-9c62-ce2c2f9e418e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
52942024-12-20T22:35:50.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 90066175-9343-46b4-8f60-0d0c376970b5 roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
52952024-12-20T22:35:50.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 90066175-9343-46b4-8f60-0d0c376970b5 resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
52962024-12-20T22:35:50.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 90066175-9343-46b4-8f60-0d0c376970b5 response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
52972024-12-20T22:35:50.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = b270d1aa-780e-4101-9c1a-ad11aded8474 roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
52982024-12-20T22:35:50.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = b270d1aa-780e-4101-9c1a-ad11aded8474 resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
52992024-12-20T22:35:50.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2512 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = b270d1aa-780e-4101-9c1a-ad11aded8474 response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
53002024-12-20T22:35:50.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
53012024-12-20T22:35:50.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53022024-12-20T22:35:50.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53032024-12-20T22:35:50.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
53042024-12-20T22:35:50.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53052024-12-20T22:35:50.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53062024-12-20T22:35:50.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53072024-12-20T22:35:50.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53082024-12-20T22:35:50.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53092024-12-20T22:35:50.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53102024-12-20T22:35:50.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53112024-12-20T22:35:50.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53122024-12-20T22:35:50.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53132024-12-20T22:35:50.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
53142024-12-20T22:35:50.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53152024-12-20T22:35:50.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53162024-12-20T22:35:50.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
53172024-12-20T22:35:50.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.015443ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
53182024-12-20T22:35:50.614ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53192024-12-20T22:35:50.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53202024-12-20T22:35:50.616ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 42.865923ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53212024-12-20T22:35:50.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 299a1ce2-452a-43a2-8302-1c5ef09037a3 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53222024-12-20T22:35:50.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 299a1ce2-452a-43a2-8302-1c5ef09037a3 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53232024-12-20T22:35:50.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 299a1ce2-452a-43a2-8302-1c5ef09037a3 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53242024-12-20T22:35:51.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fbb98561-927f-40ab-b88d-886abe36e4e6 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53252024-12-20T22:35:51.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fbb98561-927f-40ab-b88d-886abe36e4e6 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53262024-12-20T22:35:51.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fbb98561-927f-40ab-b88d-886abe36e4e6 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53272024-12-20T22:35:53.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e184428c-beaf-47f6-aad1-fb9529c98e8c roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53282024-12-20T22:35:53.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e184428c-beaf-47f6-aad1-fb9529c98e8c resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53292024-12-20T22:35:53.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e184428c-beaf-47f6-aad1-fb9529c98e8c response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53302024-12-20T22:35:54.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 25b17df6-52b5-4011-9ccd-e94d510b98db roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53312024-12-20T22:35:54.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 25b17df6-52b5-4011-9ccd-e94d510b98db resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53322024-12-20T22:35:54.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 25b17df6-52b5-4011-9ccd-e94d510b98db response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53332024-12-20T22:35:55.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 29dee531-d7ba-46e3-8ea0-d35f5f545800 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53342024-12-20T22:35:55.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 29dee531-d7ba-46e3-8ea0-d35f5f545800 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53352024-12-20T22:35:55.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1877 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 29dee531-d7ba-46e3-8ea0-d35f5f545800 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53362024-12-20T22:35:55.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 501 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 24cb4360-da23-4f75-8cdb-59d2203beec8 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
53372024-12-20T22:35:56.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ce631882-a219-4a5c-ac57-181c9a3f3b1b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53382024-12-20T22:35:56.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ce631882-a219-4a5c-ac57-181c9a3f3b1b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53392024-12-20T22:35:56.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ce631882-a219-4a5c-ac57-181c9a3f3b1b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53402024-12-20T22:35:57.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 57f5a128-b381-47c1-9a08-47339671bbab roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53412024-12-20T22:35:57.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 57f5a128-b381-47c1-9a08-47339671bbab resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53422024-12-20T22:35:57.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 57f5a128-b381-47c1-9a08-47339671bbab response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53432024-12-20T22:35:58.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7d20fe68-6fe9-468d-847a-86cc4e604c46 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53442024-12-20T22:35:58.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7d20fe68-6fe9-468d-847a-86cc4e604c46 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53452024-12-20T22:35:58.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2527 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7d20fe68-6fe9-468d-847a-86cc4e604c46 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53462024-12-20T22:35:59.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2b5a4aa4-e2b6-4da3-8b1a-becf836c3f26 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53472024-12-20T22:35:59.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2b5a4aa4-e2b6-4da3-8b1a-becf836c3f26 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53482024-12-20T22:35:59.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2b5a4aa4-e2b6-4da3-8b1a-becf836c3f26 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53492024-12-20T22:36:00.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d04374a1-c416-4a3a-b6e5-d6e2a1fa24c4 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53502024-12-20T22:36:00.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d04374a1-c416-4a3a-b6e5-d6e2a1fa24c4 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53512024-12-20T22:36:00.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d04374a1-c416-4a3a-b6e5-d6e2a1fa24c4 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
53522024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
53532024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
53542024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53552024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
53562024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
53572024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
53582024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
53592024-12-20T22:36:00.571ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:26:00.571156208 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
53602024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
53612024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
53622024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
53632024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
53642024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53652024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53662024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
53672024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
53682024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
53692024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
53702024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
53712024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53722024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53732024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
53742024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53752024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53762024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53772024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53782024-12-20T22:36:00.571ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bcf7579-f08c-458a-b8fa-486beafab77e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c65750e1-e505-4d05-b242-145c69974016.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c65750e1-e505-4d05-b242-145c69974016.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1308, tv_nsec: 184292118 } })
53792024-12-20T22:36:00.571ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b172144-6fe3-403a-b88e-6be93db6788c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e1e925bb-4266-49d2-b532-0f79860badbb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9d7e78a-d944-4f23-9be0-86e0f1334a43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9d7e78a-d944-4f23-9be0-86e0f1334a43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1308, tv_nsec: 184353059 } })
53802024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
53812024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
53822024-12-20T22:36:00.571ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e
53832024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53842024-12-20T22:36:00.571ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.37\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e"}
53852024-12-20T22:36:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53862024-12-20T22:36:00.572ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
53872024-12-20T22:36:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.018488ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
53882024-12-20T22:36:00.572ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
53892024-12-20T22:36:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.188253ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
53902024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
53912024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53922024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
53932024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
53942024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
53952024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
53962024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
53972024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53982024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53992024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
54002024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54012024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
54022024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
54032024-12-20T22:36:00.573ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
54042024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54052024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54062024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
54072024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54082024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
54092024-12-20T22:36:00.573ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
54102024-12-20T22:36:00.573ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
54112024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
54122024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
54132024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
54142024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
54152024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
54162024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54172024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
54182024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
54192024-12-20T22:36:00.573ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
54202024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54212024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
54222024-12-20T22:36:00.573ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
54232024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
54242024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
54252024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
54262024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
54272024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54282024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54292024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
54302024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54312024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
54322024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
54332024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
54342024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54352024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
54362024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54372024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54382024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54392024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
54402024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54412024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54422024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
54432024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54442024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
54452024-12-20T22:36:00.573ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
54462024-12-20T22:36:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54472024-12-20T22:36:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54482024-12-20T22:36:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54492024-12-20T22:36:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
54502024-12-20T22:36:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54512024-12-20T22:36:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54522024-12-20T22:36:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
54532024-12-20T22:36:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54542024-12-20T22:36:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54552024-12-20T22:36:00.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54562024-12-20T22:36:00.574ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.554038ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
54572024-12-20T22:36:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54582024-12-20T22:36:00.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54592024-12-20T22:36:00.575ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1308, tv_nsec: 187635550 } })
54602024-12-20T22:36:00.575ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:26:00.571156208 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
54612024-12-20T22:36:00.575ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.00125ms iteration = 11 status = {"expiration":"2024-12-20T22:26:00.571156208Z","pruned":[]}
54622024-12-20T22:36:00.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54632024-12-20T22:36:00.575ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
54642024-12-20T22:36:00.575ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1308, tv_nsec: 188091183 } })
54652024-12-20T22:36:00.575ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
54662024-12-20T22:36:00.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54672024-12-20T22:36:00.578ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54682024-12-20T22:36:00.579ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54692024-12-20T22:36:00.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54702024-12-20T22:36:00.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54712024-12-20T22:36:00.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54722024-12-20T22:36:00.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54732024-12-20T22:36:00.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54742024-12-20T22:36:00.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54752024-12-20T22:36:00.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54762024-12-20T22:36:00.582ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54772024-12-20T22:36:00.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54782024-12-20T22:36:00.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54792024-12-20T22:36:00.584ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54802024-12-20T22:36:00.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54812024-12-20T22:36:00.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54822024-12-20T22:36:00.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54832024-12-20T22:36:00.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54842024-12-20T22:36:00.586ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54852024-12-20T22:36:00.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54862024-12-20T22:36:00.588ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.350883ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
54872024-12-20T22:36:00.589ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54882024-12-20T22:36:00.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54892024-12-20T22:36:00.591ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54902024-12-20T22:36:00.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54912024-12-20T22:36:00.595ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54922024-12-20T22:36:00.598ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54932024-12-20T22:36:00.598ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
54942024-12-20T22:36:00.598ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
54952024-12-20T22:36:00.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54962024-12-20T22:36:00.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
54972024-12-20T22:36:00.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54982024-12-20T22:36:00.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54992024-12-20T22:36:00.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55002024-12-20T22:36:00.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1308, tv_nsec: 220048515 } })
55012024-12-20T22:36:00.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55022024-12-20T22:36:00.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
55032024-12-20T22:36:00.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55042024-12-20T22:36:00.623ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55052024-12-20T22:36:00.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55062024-12-20T22:36:00.623ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55072024-12-20T22:36:00.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55082024-12-20T22:36:00.624ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55092024-12-20T22:36:00.624ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55102024-12-20T22:36:00.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55112024-12-20T22:36:00.626ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55122024-12-20T22:36:00.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55132024-12-20T22:36:00.629ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(9704e2b1-28c4-4f3f-9916-9ce1452e51d1, 0), (3fca44d8-3a4a-4c86-ba98-4b248ddcb42a, 0), (3521ebbb-8abf-41fc-a7d0-bb58ec433e0c, 0), (03cca0a6-bdcc-46e4-bd6f-3a9944f0f558, 0)] collection_id = 9704e2b1-28c4-4f3f-9916-9ce1452e51d1
55142024-12-20T22:36:00.629ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
55152024-12-20T22:36:00.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
55162024-12-20T22:36:00.629ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55172024-12-20T22:36:00.630ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55182024-12-20T22:36:00.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55192024-12-20T22:36:00.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55202024-12-20T22:36:00.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55212024-12-20T22:36:00.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
55222024-12-20T22:36:00.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55232024-12-20T22:36:00.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55242024-12-20T22:36:00.643ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
55252024-12-20T22:36:00.643ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
55262024-12-20T22:36:00.643ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 70.164337ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
55272024-12-20T22:36:00.647ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55282024-12-20T22:36:00.648ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55292024-12-20T22:36:00.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55302024-12-20T22:36:00.649ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
55312024-12-20T22:36:00.649ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55322024-12-20T22:36:00.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55332024-12-20T22:36:00.650ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55342024-12-20T22:36:00.650ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
55352024-12-20T22:36:00.650ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55362024-12-20T22:36:00.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55372024-12-20T22:36:00.654ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 80.79624ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
55382024-12-20T22:36:00.656ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55392024-12-20T22:36:00.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55402024-12-20T22:36:00.659ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55412024-12-20T22:36:00.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55422024-12-20T22:36:00.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55432024-12-20T22:36:00.671ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
55442024-12-20T22:36:00.671ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 97.672025ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
55452024-12-20T22:36:00.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55462024-12-20T22:36:00.675ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
55472024-12-20T22:36:00.675ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
55482024-12-20T22:36:00.675ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
55492024-12-20T22:36:00.675ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55502024-12-20T22:36:00.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55512024-12-20T22:36:00.677ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55522024-12-20T22:36:00.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
55532024-12-20T22:36:00.679ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
55542024-12-20T22:36:00.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
55552024-12-20T22:36:00.685ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 112.025212ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
55562024-12-20T22:36:00.688ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 115.248551ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55572024-12-20T22:36:00.689ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
55582024-12-20T22:36:00.689ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 116.213317ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
55592024-12-20T22:36:00.711ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
55602024-12-20T22:36:00.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
55612024-12-20T22:36:00.722ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
55622024-12-20T22:36:00.722ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
55632024-12-20T22:36:00.722ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
55642024-12-20T22:36:00.722ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55652024-12-20T22:36:00.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55662024-12-20T22:36:00.726ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
55672024-12-20T22:36:00.726ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55682024-12-20T22:36:00.726ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fea7c109-9fb6-4900-8cf5-c089120abf00", "content-length": "26", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
55692024-12-20T22:36:00.726ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55702024-12-20T22:36:00.728ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55712024-12-20T22:36:00.747ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55722024-12-20T22:36:00.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55732024-12-20T22:36:00.762ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55742024-12-20T22:36:00.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55752024-12-20T22:36:00.771ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
55762024-12-20T22:36:00.771ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55772024-12-20T22:36:00.772ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "498b41b2-130a-4d08-a97c-10b02eca7d6b", "content-length": "26", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
55782024-12-20T22:36:00.772ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55792024-12-20T22:36:00.773ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55802024-12-20T22:36:00.803ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 zone_address = fd00:1122:3344:101::2
55812024-12-20T22:36:00.803ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55822024-12-20T22:36:00.803ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eeb52f9b-b31e-42a5-a66b-29d912c041e9", "content-length": "26", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
55832024-12-20T22:36:00.804ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55842024-12-20T22:36:00.806ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
55852024-12-20T22:36:00.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 955e2713-2e1d-4521-8368-fcfb597ac95f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
55862024-12-20T22:36:00.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 955e2713-2e1d-4521-8368-fcfb597ac95f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
55872024-12-20T22:36:00.846ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
55882024-12-20T22:36:00.846ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55892024-12-20T22:36:00.846ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "541f7bfd-cd86-4ec7-837f-5ed2f275b5cd", "content-length": "372", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
55902024-12-20T22:36:00.846ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55912024-12-20T22:36:00.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55922024-12-20T22:36:00.848ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
55932024-12-20T22:36:00.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55942024-12-20T22:36:00.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 277.365185ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55952024-12-20T22:36:00.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55962024-12-20T22:36:00.851ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55972024-12-20T22:36:00.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55982024-12-20T22:36:00.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55992024-12-20T22:36:00.852ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56002024-12-20T22:36:00.852ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
56012024-12-20T22:36:00.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56022024-12-20T22:36:00.852ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56032024-12-20T22:36:00.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56042024-12-20T22:36:00.853ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
56052024-12-20T22:36:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
56062024-12-20T22:36:00.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56072024-12-20T22:36:00.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56082024-12-20T22:36:00.858ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
56092024-12-20T22:36:00.858ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 286.685021ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
56102024-12-20T22:36:00.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 955e2713-2e1d-4521-8368-fcfb597ac95f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
56112024-12-20T22:36:00.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56122024-12-20T22:36:00.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
56132024-12-20T22:36:00.862ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56142024-12-20T22:36:00.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56152024-12-20T22:36:00.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56162024-12-20T22:36:00.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56172024-12-20T22:36:00.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56182024-12-20T22:36:00.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56192024-12-20T22:36:00.889ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56202024-12-20T22:36:00.889ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
56212024-12-20T22:36:00.893ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
56222024-12-20T22:36:00.893ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56232024-12-20T22:36:00.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56242024-12-20T22:36:00.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56252024-12-20T22:36:00.898ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 325.323077ms iteration = 21 status = 0
56262024-12-20T22:36:00.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
56272024-12-20T22:36:00.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56282024-12-20T22:36:00.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56292024-12-20T22:36:00.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 331.031015ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
56302024-12-20T22:36:00.904ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 333.543405ms iteration = 21 status = {}
56312024-12-20T22:36:00.915ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
56322024-12-20T22:36:00.915ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
56332024-12-20T22:36:00.915ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 341.607437ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
56342024-12-20T22:36:00.918ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 344.786945ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
56352024-12-20T22:36:00.923ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
56362024-12-20T22:36:00.923ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
56372024-12-20T22:36:00.923ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56382024-12-20T22:36:00.923ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56392024-12-20T22:36:00.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56402024-12-20T22:36:00.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56412024-12-20T22:36:00.924ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56422024-12-20T22:36:00.925ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56432024-12-20T22:36:00.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56442024-12-20T22:36:00.925ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56452024-12-20T22:36:00.926ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56462024-12-20T22:36:00.927ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
56472024-12-20T22:36:00.927ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 353.66028ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
56482024-12-20T22:36:00.927ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
56492024-12-20T22:36:00.927ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56502024-12-20T22:36:00.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56512024-12-20T22:36:00.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
56522024-12-20T22:36:00.928ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56532024-12-20T22:36:00.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56542024-12-20T22:36:00.931ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
56552024-12-20T22:36:00.931ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
56562024-12-20T22:36:00.931ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:26:39.700273 UTC dns_group = internal generation = 1
56572024-12-20T22:36:00.931ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 360.323463ms iteration = 11 status = {"generation":1}
56582024-12-20T22:36:00.932ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
56592024-12-20T22:36:00.932ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "18665efe-737f-4741-9f55-55e755c16a64", "content-length": "1", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
56602024-12-20T22:36:00.932ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
56612024-12-20T22:36:00.932ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
56622024-12-20T22:36:00.933ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "65f45976-eec1-46eb-9253-f1fc702352e4", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
56632024-12-20T22:36:00.933ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56642024-12-20T22:36:00.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56652024-12-20T22:36:00.934ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56662024-12-20T22:36:00.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56672024-12-20T22:36:00.936ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56682024-12-20T22:36:00.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56692024-12-20T22:36:00.936ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 365.880717ms iteration = 21 status = null
56702024-12-20T22:36:00.939ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56712024-12-20T22:36:00.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56722024-12-20T22:36:00.943ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
56732024-12-20T22:36:00.943ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56742024-12-20T22:36:00.944ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9a8845d3-65a5-4a30-94cf-0eb7b7a14136", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
56752024-12-20T22:36:00.945ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 372.417828ms iteration = 21 status = {}
56762024-12-20T22:36:00.962ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
56772024-12-20T22:36:00.962ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 0 version = 2
56782024-12-20T22:36:00.962ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56792024-12-20T22:36:00.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56802024-12-20T22:36:00.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56812024-12-20T22:36:00.966ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 9704e2b1-28c4-4f3f-9916-9ce1452e51d1 file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
56822024-12-20T22:36:00.966ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
56832024-12-20T22:36:00.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
56842024-12-20T22:36:00.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
56852024-12-20T22:36:00.970ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56862024-12-20T22:36:00.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56872024-12-20T22:36:00.974ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
56882024-12-20T22:36:00.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
56892024-12-20T22:36:00.974ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 1 version = 2
56902024-12-20T22:36:00.975ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
56912024-12-20T22:36:00.975ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:26:40.428768 UTC dns_group = external generation = 2
56922024-12-20T22:36:00.975ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 403.811923ms iteration = 11 status = {"generation":2}
56932024-12-20T22:36:00.975ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56942024-12-20T22:36:00.976ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:25:57.040586Z, time_modified: 2024-12-20T22:25:57.040586Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }) }
56952024-12-20T22:36:00.976ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 405.11298ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]}},"default_endpoint":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
56962024-12-20T22:36:00.976ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(3fca44d8-3a4a-4c86-ba98-4b248ddcb42a, 0), (3521ebbb-8abf-41fc-a7d0-bb58ec433e0c, 0), (03cca0a6-bdcc-46e4-bd6f-3a9944f0f558, 0), (a7a25105-dc1d-4f8d-8dec-56cf668c07be, 0)] collection_id = 3fca44d8-3a4a-4c86-ba98-4b248ddcb42a
56972024-12-20T22:36:00.976ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
56982024-12-20T22:36:00.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
56992024-12-20T22:36:00.979ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
57002024-12-20T22:36:00.979ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57012024-12-20T22:36:00.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57022024-12-20T22:36:00.980ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57032024-12-20T22:36:00.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57042024-12-20T22:36:00.982ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57052024-12-20T22:36:00.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57062024-12-20T22:36:00.993ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 420.204906ms iteration = 23 status = {"physical_disks_added":0}
57072024-12-20T22:36:01.013ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
57082024-12-20T22:36:01.013ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 440.521747ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
57092024-12-20T22:36:01.025ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57102024-12-20T22:36:01.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57112024-12-20T22:36:01.027ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57122024-12-20T22:36:01.029ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57132024-12-20T22:36:01.029ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57142024-12-20T22:36:01.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57152024-12-20T22:36:01.031ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57162024-12-20T22:36:01.033ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57172024-12-20T22:36:01.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57182024-12-20T22:36:01.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57192024-12-20T22:36:01.034ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57202024-12-20T22:36:01.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
57212024-12-20T22:36:01.037ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57222024-12-20T22:36:01.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57232024-12-20T22:36:01.040ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57242024-12-20T22:36:01.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57252024-12-20T22:36:01.043ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57262024-12-20T22:36:01.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57272024-12-20T22:36:01.045ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57282024-12-20T22:36:01.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57292024-12-20T22:36:01.046ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57302024-12-20T22:36:01.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57312024-12-20T22:36:01.090ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
57322024-12-20T22:36:01.094ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
57332024-12-20T22:36:01.095ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a7e71680-d367-411d-82e3-221d7793ee13", "date": "Fri, 20 Dec 2024 22:36:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57342024-12-20T22:36:01.095ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57352024-12-20T22:36:01.096ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 3fca44d8-3a4a-4c86-ba98-4b248ddcb42a file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
57362024-12-20T22:36:01.096ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
57372024-12-20T22:36:01.096ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f5b0e4b9-b260-4816-b452-733d72853669", "date": "Fri, 20 Dec 2024 22:36:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57382024-12-20T22:36:01.096ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57392024-12-20T22:36:01.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
57402024-12-20T22:36:01.098ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
57412024-12-20T22:36:01.098ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 527.26896ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
57422024-12-20T22:36:01.130ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
57432024-12-20T22:36:01.130ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "beabf84b-7d65-4224-a182-3b0299e93eea", "content-length": "691", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
57442024-12-20T22:36:01.130ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
57452024-12-20T22:36:01.130ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
57462024-12-20T22:36:01.130ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
57472024-12-20T22:36:01.131ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57482024-12-20T22:36:01.131ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 558.124292ms iteration = 21 status = {}
57492024-12-20T22:36:01.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57502024-12-20T22:36:01.133ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(3521ebbb-8abf-41fc-a7d0-bb58ec433e0c, 0), (03cca0a6-bdcc-46e4-bd6f-3a9944f0f558, 0), (a7a25105-dc1d-4f8d-8dec-56cf668c07be, 0)]
57512024-12-20T22:36:01.134ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1308, tv_nsec: 746552274 } })
57522024-12-20T22:36:01.137ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57532024-12-20T22:36:01.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57542024-12-20T22:36:01.140ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9fedf0d4-8a86-4506-bf93-224faabd5e37, rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b26f0563-25fb-4d7c-8480-dd368ac01105) } rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
57552024-12-20T22:36:01.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57562024-12-20T22:36:01.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57572024-12-20T22:36:01.151ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
57582024-12-20T22:36:01.151ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d34dad6e-2211-49e8-8b77-4508bfddfaf1", "content-length": "134", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
57592024-12-20T22:36:01.151ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
57602024-12-20T22:36:01.151ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b26f0563-25fb-4d7c-8480-dd368ac01105
57612024-12-20T22:36:01.152ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
57622024-12-20T22:36:01.152ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
57632024-12-20T22:36:01.152ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57642024-12-20T22:36:01.152ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57652024-12-20T22:36:01.152ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57662024-12-20T22:36:01.152ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57672024-12-20T22:36:01.152ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57682024-12-20T22:36:01.152ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57692024-12-20T22:36:01.152ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
57702024-12-20T22:36:01.152ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57712024-12-20T22:36:01.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57722024-12-20T22:36:01.154ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
57732024-12-20T22:36:01.154ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "38d6f978-67cd-4efa-be7e-eb9fb9c900f1", "content-length": "2", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
57742024-12-20T22:36:01.154ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
57752024-12-20T22:36:01.154ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "55a9298e-e91f-43c7-98c4-1f50ff24f17d", "content-length": "52", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
57762024-12-20T22:36:01.154ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
57772024-12-20T22:36:01.154ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
57782024-12-20T22:36:01.165ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
57792024-12-20T22:36:01.165ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "28e0180b-0eb7-4dd2-b49f-0bd9ce8df279", "date": "Fri, 20 Dec 2024 22:36:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57802024-12-20T22:36:01.165ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57812024-12-20T22:36:01.167ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "1f2a4df1-a388-4659-84b7-d598d73ae553", "date": "Fri, 20 Dec 2024 22:36:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57822024-12-20T22:36:01.167ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57832024-12-20T22:36:01.169ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "061dc802-6d29-4de8-8f25-f83b1777e0c9", "date": "Fri, 20 Dec 2024 22:36:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57842024-12-20T22:36:01.169ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57852024-12-20T22:36:01.171ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
57862024-12-20T22:36:01.171ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 600.010898ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
57872024-12-20T22:36:01.174ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57882024-12-20T22:36:01.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57892024-12-20T22:36:01.176ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57902024-12-20T22:36:01.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
57912024-12-20T22:36:01.179ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
57922024-12-20T22:36:01.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
57932024-12-20T22:36:01.181ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
57942024-12-20T22:36:01.181ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
57952024-12-20T22:36:01.181ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
57962024-12-20T22:36:01.181ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "723d81d5-a0e3-42d4-940a-5d11f04f16f7", "content-length": "476", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
57972024-12-20T22:36:01.181ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
57982024-12-20T22:36:01.181ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd500818-9b1b-4fc6-992c-35dd5f9f05be", "content-length": "734", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
57992024-12-20T22:36:01.181ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58002024-12-20T22:36:01.181ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
58012024-12-20T22:36:01.182ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e145939-ff38-4baa-81a3-be11e3bc80be", "content-length": "111", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
58022024-12-20T22:36:01.182ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
58032024-12-20T22:36:01.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58042024-12-20T22:36:01.182ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b8768d0-48ea-4b5e-9d9b-24e8840c4cf4", "content-length": "111", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
58052024-12-20T22:36:01.182ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
58062024-12-20T22:36:01.182ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "51421474-a3a8-4636-8bbd-4a9f9dc534a9", "content-length": "167", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
58072024-12-20T22:36:01.182ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
58082024-12-20T22:36:01.183ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f18895db-f917-4d46-9367-b239ecb52535", "content-length": "167", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
58092024-12-20T22:36:01.183ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
58102024-12-20T22:36:01.183ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2017658f-f98c-4f16-ae69-b0e71cd05827", "content-length": "175", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
58112024-12-20T22:36:01.183ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
58122024-12-20T22:36:01.183ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "26650e02-def0-499a-9bb3-ac789b78fe7e", "content-length": "175", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
58132024-12-20T22:36:01.183ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
58142024-12-20T22:36:01.183ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcb05262-eda2-4a9a-bccc-77ec84839663", "content-length": "702", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
58152024-12-20T22:36:01.183ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
58162024-12-20T22:36:01.184ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9aff1717-32f2-4cff-a9b4-b0d0aa0be207", "content-length": "727", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
58172024-12-20T22:36:01.184ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
58182024-12-20T22:36:01.184ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "56c3e598-351f-434e-918f-c59161a98e34", "content-length": "729", "date": "Fri, 20 Dec 2024 22:36:01 GMT"} })
58192024-12-20T22:36:01.184ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
58202024-12-20T22:36:01.184ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58212024-12-20T22:36:01.184ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "24dce274-db14-4293-9467-a30a76f23606", "content-length": "728", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
58222024-12-20T22:36:01.184ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
58232024-12-20T22:36:01.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58242024-12-20T22:36:01.184ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "278f7d39-8cba-4bbf-a2d4-e3f366c5c97a", "content-length": "722", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
58252024-12-20T22:36:01.184ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
58262024-12-20T22:36:01.184ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "85e53801-a49b-4067-9137-6b5d9f3db735", "content-length": "109", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
58272024-12-20T22:36:01.184ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
58282024-12-20T22:36:01.185ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "528be636-b485-4625-a4b0-883ac547a3f2", "content-length": "109", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
58292024-12-20T22:36:01.185ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
58302024-12-20T22:36:01.185ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fd3dc0c-85a3-4807-b5ff-4f48125b08ac", "content-length": "169", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
58312024-12-20T22:36:01.185ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
58322024-12-20T22:36:01.185ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7b1c8bb-6424-4e1b-b9c1-ad137e8b8679", "content-length": "169", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
58332024-12-20T22:36:01.185ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
58342024-12-20T22:36:01.186ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "11406a3b-542a-418a-89e8-aa7e600e0666", "content-length": "178", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
58352024-12-20T22:36:01.186ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
58362024-12-20T22:36:01.186ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a30a4404-aa24-44bd-8913-41a0bcce16a3", "content-length": "178", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
58372024-12-20T22:36:01.186ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
58382024-12-20T22:36:01.186ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9422c961-4075-4b9a-860b-8f595ddba329", "content-length": "702", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
58392024-12-20T22:36:01.186ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
58402024-12-20T22:36:01.186ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b689b9cd-c5df-4d9d-bcba-bc7cdecda053", "content-length": "727", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
58412024-12-20T22:36:01.186ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
58422024-12-20T22:36:01.186ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "93465f78-cbf5-4786-b483-4b5f333c6c79", "content-length": "729", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
58432024-12-20T22:36:01.186ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
58442024-12-20T22:36:01.186ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "259062e1-dd31-493d-ab35-9779b23dff39", "content-length": "728", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
58452024-12-20T22:36:01.186ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
58462024-12-20T22:36:01.186ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58472024-12-20T22:36:01.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
58482024-12-20T22:36:01.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58492024-12-20T22:36:01.188ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58502024-12-20T22:36:01.189ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58512024-12-20T22:36:01.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58522024-12-20T22:36:01.190ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
58532024-12-20T22:36:01.190ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
58542024-12-20T22:36:01.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
58552024-12-20T22:36:01.191ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58562024-12-20T22:36:01.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58572024-12-20T22:36:01.192ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58582024-12-20T22:36:01.192ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58592024-12-20T22:36:01.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58602024-12-20T22:36:01.194ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58612024-12-20T22:36:01.194ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
58622024-12-20T22:36:01.194ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
58632024-12-20T22:36:01.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
58642024-12-20T22:36:01.197ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
58652024-12-20T22:36:01.197ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58662024-12-20T22:36:01.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58672024-12-20T22:36:01.199ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58682024-12-20T22:36:01.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58692024-12-20T22:36:01.200ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58702024-12-20T22:36:01.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58712024-12-20T22:36:01.201ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58722024-12-20T22:36:01.205ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
58732024-12-20T22:36:01.205ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58742024-12-20T22:36:01.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58752024-12-20T22:36:01.210ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58762024-12-20T22:36:01.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58772024-12-20T22:36:01.227ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
58782024-12-20T22:36:01.227ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
58792024-12-20T22:36:01.229ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58802024-12-20T22:36:01.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58812024-12-20T22:36:01.231ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58822024-12-20T22:36:01.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58832024-12-20T22:36:01.234ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58842024-12-20T22:36:01.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58852024-12-20T22:36:01.236ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58862024-12-20T22:36:01.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58872024-12-20T22:36:01.238ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58882024-12-20T22:36:01.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58892024-12-20T22:36:01.239ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58902024-12-20T22:36:01.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58912024-12-20T22:36:01.241ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58922024-12-20T22:36:01.245ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
58932024-12-20T22:36:01.245ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58942024-12-20T22:36:01.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58952024-12-20T22:36:01.247ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58962024-12-20T22:36:01.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58972024-12-20T22:36:01.249ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58982024-12-20T22:36:01.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58992024-12-20T22:36:01.250ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59002024-12-20T22:36:01.253ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
59012024-12-20T22:36:01.254ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59022024-12-20T22:36:01.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59032024-12-20T22:36:01.254ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "acfa00d5-6939-4e7c-8e51-4706df3fc331", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
59042024-12-20T22:36:01.254ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch = Switch0
59052024-12-20T22:36:01.254ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
59062024-12-20T22:36:01.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 67e2b774-8b0b-41cd-b968-29502eead540 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59072024-12-20T22:36:01.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 67e2b774-8b0b-41cd-b968-29502eead540 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59082024-12-20T22:36:01.255ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "48f37e29-90b1-4ca2-9b78-06e6f04d5e85", "content-length": "682", "date": "Fri, 20 Dec 2024 22:36:01 GMT"} })
59092024-12-20T22:36:01.255ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59102024-12-20T22:36:01.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59112024-12-20T22:36:01.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 67e2b774-8b0b-41cd-b968-29502eead540 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59122024-12-20T22:36:01.263ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 7db65b4a-d789-43c3-984f-c485a4e2a375, kind: Service { id: c08fb79e-9df2-49bb-be41-3925df103e75 }, name: Name("nexus-c08fb79e-9df2-49bb-be41-3925df103e75"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b363f91f-4d69-4910-94ae-1db154f74729, kind: Service { id: 6f9920e4-f78b-446d-a886-f757caf64a7f }, name: Name("nexus-6f9920e4-f78b-446d-a886-f757caf64a7f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 70])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d90729b8-5bad-445f-b9c0-90b3d17d83cf, kind: Service { id: d53e973e-73fc-4117-a9f7-47305be7e74c }, name: Name("nexus-d53e973e-73fc-4117-a9f7-47305be7e74c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 753bd9a0-35c0-4591-b136-cfc90d2d7d2f, kind: Service { id: c65750e1-e505-4d05-b242-145c69974016 }, name: Name("external-dns-c65750e1-e505-4d05-b242-145c69974016"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c5f51553-50ea-408f-ac16-b1e53e3102de, kind: Service { id: 9bcf7579-f08c-458a-b8fa-486beafab77e }, name: Name("external-dns-9bcf7579-f08c-458a-b8fa-486beafab77e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 93])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
59132024-12-20T22:36:01.263ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59142024-12-20T22:36:01.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59152024-12-20T22:36:01.264ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59162024-12-20T22:36:01.265ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59172024-12-20T22:36:01.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59182024-12-20T22:36:01.267ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
59192024-12-20T22:36:01.268ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59202024-12-20T22:36:01.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59212024-12-20T22:36:01.269ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59222024-12-20T22:36:01.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59232024-12-20T22:36:01.270ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
59242024-12-20T22:36:01.270ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 753bd9a0-35c0-4591-b136-cfc90d2d7d2f, kind: Service { id: c65750e1-e505-4d05-b242-145c69974016 }, name: Name("external-dns-c65750e1-e505-4d05-b242-145c69974016"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c5f51553-50ea-408f-ac16-b1e53e3102de, kind: Service { id: 9bcf7579-f08c-458a-b8fa-486beafab77e }, name: Name("external-dns-9bcf7579-f08c-458a-b8fa-486beafab77e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 93])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 7db65b4a-d789-43c3-984f-c485a4e2a375, kind: Service { id: c08fb79e-9df2-49bb-be41-3925df103e75 }, name: Name("nexus-c08fb79e-9df2-49bb-be41-3925df103e75"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b363f91f-4d69-4910-94ae-1db154f74729, kind: Service { id: 6f9920e4-f78b-446d-a886-f757caf64a7f }, name: Name("nexus-6f9920e4-f78b-446d-a886-f757caf64a7f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 70])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d90729b8-5bad-445f-b9c0-90b3d17d83cf, kind: Service { id: d53e973e-73fc-4117-a9f7-47305be7e74c }, name: Name("nexus-d53e973e-73fc-4117-a9f7-47305be7e74c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
59252024-12-20T22:36:01.270ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
59262024-12-20T22:36:01.271ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59272024-12-20T22:36:01.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59282024-12-20T22:36:01.279ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 706.592709ms iteration = 21 status = {}
59292024-12-20T22:36:01.424ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, time_created: 2024-12-20T22:26:35.129481Z, time_modified: 2024-12-20T22:26:35.129481Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
59302024-12-20T22:36:01.424ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
59312024-12-20T22:36:01.424ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59322024-12-20T22:36:01.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59332024-12-20T22:36:01.427ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59342024-12-20T22:36:01.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59352024-12-20T22:36:01.429ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59362024-12-20T22:36:01.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
59372024-12-20T22:36:01.463ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
59382024-12-20T22:36:01.467ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "0544a3fb-384f-47e8-bd67-25269052022f", "date": "Fri, 20 Dec 2024 22:36:01 GMT"} })
59392024-12-20T22:36:01.468ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
59402024-12-20T22:36:01.469ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 895.509463ms
59412024-12-20T22:36:01.469ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 895.519363ms iteration = 3 status = {}
59422024-12-20T22:36:01.476ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca11f051-5544-4ce7-8812-20d058e76872", "content-length": "30799", "date": "Fri, 20 Dec 2024 22:36:00 GMT"} })
59432024-12-20T22:36:01.478ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
59442024-12-20T22:36:01.478ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
59452024-12-20T22:36:01.478ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
59462024-12-20T22:36:01.480ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
59472024-12-20T22:36:01.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
59482024-12-20T22:36:01.482ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59492024-12-20T22:36:01.484ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
59502024-12-20T22:36:01.484ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
59512024-12-20T22:36:01.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
59522024-12-20T22:36:01.666ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 856e3bd7-f4b9-4e52-96cb-7c3a34848bdb file = nexus/db-queries/src/db/datastore/inventory.rs:1010
59532024-12-20T22:36:01.666ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 856e3bd7-f4b9-4e52-96cb-7c3a34848bdb time_started = 2024-12-20 22:36:01.181068 UTC
59542024-12-20T22:36:01.666ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.093521557s iteration = 3 status = {"collection_id":"856e3bd7-f4b9-4e52-96cb-7c3a34848bdb","time_done":"2024-12-20 22:36:01.478481 UTC","time_started":"2024-12-20 22:36:01.181068 UTC"}
59552024-12-20T22:36:01.667ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
59562024-12-20T22:36:01.667ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59572024-12-20T22:36:01.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59582024-12-20T22:36:01.668ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59592024-12-20T22:36:01.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59602024-12-20T22:36:01.670ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59612024-12-20T22:36:01.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59622024-12-20T22:36:01.673ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59632024-12-20T22:36:01.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59642024-12-20T22:36:01.675ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59652024-12-20T22:36:01.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59662024-12-20T22:36:01.677ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59672024-12-20T22:36:01.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59682024-12-20T22:36:01.807ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 140.829097ms iteration = 24 status = {"physical_disks_added":0}
59692024-12-20T22:36:02.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 69421795-6279-428f-ac06-6f4b9e8bbaaa roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59702024-12-20T22:36:02.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 69421795-6279-428f-ac06-6f4b9e8bbaaa resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59712024-12-20T22:36:02.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 69421795-6279-428f-ac06-6f4b9e8bbaaa response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59722024-12-20T22:36:03.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1d0e09b0-4c61-4994-8348-b50b9030dcfe roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59732024-12-20T22:36:03.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1d0e09b0-4c61-4994-8348-b50b9030dcfe resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59742024-12-20T22:36:03.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1d0e09b0-4c61-4994-8348-b50b9030dcfe response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59752024-12-20T22:36:04.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 05b065e3-5682-4efb-8f30-94ba806651ec roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59762024-12-20T22:36:04.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 05b065e3-5682-4efb-8f30-94ba806651ec resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59772024-12-20T22:36:04.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2673 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 05b065e3-5682-4efb-8f30-94ba806651ec response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59782024-12-20T22:36:05.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 513 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 550761f2-0cb1-46de-a334-6c38bfe6c33c response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
59792024-12-20T22:36:05.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 71907a81-c91c-46a7-99a1-ee43b62a3f99 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59802024-12-20T22:36:05.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 71907a81-c91c-46a7-99a1-ee43b62a3f99 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59812024-12-20T22:36:05.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1763 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 71907a81-c91c-46a7-99a1-ee43b62a3f99 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59822024-12-20T22:36:06.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8aab3f1b-4022-4047-8acc-385bf6909e20 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59832024-12-20T22:36:06.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8aab3f1b-4022-4047-8acc-385bf6909e20 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59842024-12-20T22:36:06.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8aab3f1b-4022-4047-8acc-385bf6909e20 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59852024-12-20T22:36:07.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 06ec569a-ba88-4190-99a0-ae35b9dd7833 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59862024-12-20T22:36:07.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 06ec569a-ba88-4190-99a0-ae35b9dd7833 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59872024-12-20T22:36:07.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 06ec569a-ba88-4190-99a0-ae35b9dd7833 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59882024-12-20T22:36:08.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 992f88fb-80da-4043-8dc7-f75a2510da70 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59892024-12-20T22:36:08.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 992f88fb-80da-4043-8dc7-f75a2510da70 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59902024-12-20T22:36:08.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 992f88fb-80da-4043-8dc7-f75a2510da70 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59912024-12-20T22:36:09.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 248017d4-7d6c-4ac0-bdaf-1c979f19c043 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59922024-12-20T22:36:09.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 248017d4-7d6c-4ac0-bdaf-1c979f19c043 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59932024-12-20T22:36:09.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2035 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 248017d4-7d6c-4ac0-bdaf-1c979f19c043 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59942024-12-20T22:36:10.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 208fbc96-0d03-4b7f-a443-e7ff96d0805d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59952024-12-20T22:36:10.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 208fbc96-0d03-4b7f-a443-e7ff96d0805d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59962024-12-20T22:36:10.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 208fbc96-0d03-4b7f-a443-e7ff96d0805d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
59972024-12-20T22:36:10.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
59982024-12-20T22:36:10.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59992024-12-20T22:36:10.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60002024-12-20T22:36:10.572ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
60012024-12-20T22:36:10.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60022024-12-20T22:36:10.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60032024-12-20T22:36:10.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60042024-12-20T22:36:10.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60052024-12-20T22:36:10.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60062024-12-20T22:36:10.576ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.906317ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60072024-12-20T22:36:10.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60082024-12-20T22:36:10.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60092024-12-20T22:36:10.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60102024-12-20T22:36:10.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60112024-12-20T22:36:10.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60122024-12-20T22:36:10.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60132024-12-20T22:36:10.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
60142024-12-20T22:36:10.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60152024-12-20T22:36:10.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60162024-12-20T22:36:10.592ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
60172024-12-20T22:36:10.592ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.341721ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
60182024-12-20T22:36:11.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3d431751-894d-4d68-9fb6-65a539c4d1b5 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60192024-12-20T22:36:11.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3d431751-894d-4d68-9fb6-65a539c4d1b5 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60202024-12-20T22:36:11.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3d431751-894d-4d68-9fb6-65a539c4d1b5 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60212024-12-20T22:36:12.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5c5c3da0-525b-4d4d-8d27-f56f62c0e8cc roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60222024-12-20T22:36:12.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5c5c3da0-525b-4d4d-8d27-f56f62c0e8cc resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60232024-12-20T22:36:12.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5c5c3da0-525b-4d4d-8d27-f56f62c0e8cc response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60242024-12-20T22:36:13.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a4f6a705-9524-442d-a31b-fad63a4393d6 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60252024-12-20T22:36:13.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a4f6a705-9524-442d-a31b-fad63a4393d6 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60262024-12-20T22:36:13.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a4f6a705-9524-442d-a31b-fad63a4393d6 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60272024-12-20T22:36:14.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fe699e3a-b4b3-4b42-8074-2e46a6c55c8f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60282024-12-20T22:36:14.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fe699e3a-b4b3-4b42-8074-2e46a6c55c8f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60292024-12-20T22:36:14.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1768 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fe699e3a-b4b3-4b42-8074-2e46a6c55c8f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60302024-12-20T22:36:15.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 599 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 0993324a-4553-4245-8f61-022db6af9f66 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
60312024-12-20T22:36:15.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0ed60082-9efb-483c-b17b-1a150fa6456a roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60322024-12-20T22:36:15.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0ed60082-9efb-483c-b17b-1a150fa6456a resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60332024-12-20T22:36:15.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2416 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0ed60082-9efb-483c-b17b-1a150fa6456a response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60342024-12-20T22:36:16.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 45b3381d-e937-4ff4-a89f-dc32ec5ac955 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60352024-12-20T22:36:16.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 45b3381d-e937-4ff4-a89f-dc32ec5ac955 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60362024-12-20T22:36:16.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 45b3381d-e937-4ff4-a89f-dc32ec5ac955 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60372024-12-20T22:36:17.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 86f248b3-3447-44d0-9999-1ae47f42819a roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60382024-12-20T22:36:17.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 86f248b3-3447-44d0-9999-1ae47f42819a resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60392024-12-20T22:36:17.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 86f248b3-3447-44d0-9999-1ae47f42819a response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60402024-12-20T22:36:18.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 76f4dcfa-d3e8-4285-a635-a7c3a1d02645 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60412024-12-20T22:36:18.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 76f4dcfa-d3e8-4285-a635-a7c3a1d02645 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60422024-12-20T22:36:18.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 76f4dcfa-d3e8-4285-a635-a7c3a1d02645 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60432024-12-20T22:36:19.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3caaa769-a1ef-4ab2-80e1-823b7ef591ec roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60442024-12-20T22:36:19.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3caaa769-a1ef-4ab2-80e1-823b7ef591ec resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60452024-12-20T22:36:19.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1927 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3caaa769-a1ef-4ab2-80e1-823b7ef591ec response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60462024-12-20T22:36:20.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 60d2b3c2-8b72-45f9-a182-6f535487db5f roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
60472024-12-20T22:36:20.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 60d2b3c2-8b72-45f9-a182-6f535487db5f resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
60482024-12-20T22:36:20.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 60d2b3c2-8b72-45f9-a182-6f535487db5f response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
60492024-12-20T22:36:20.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 5ec92140-9e2c-4a88-b4a5-1a222c4c4510 roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
60502024-12-20T22:36:20.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 5ec92140-9e2c-4a88-b4a5-1a222c4c4510 resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
60512024-12-20T22:36:20.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 5ec92140-9e2c-4a88-b4a5-1a222c4c4510 response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
60522024-12-20T22:36:20.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
60532024-12-20T22:36:20.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60542024-12-20T22:36:20.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60552024-12-20T22:36:20.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
60562024-12-20T22:36:20.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60572024-12-20T22:36:20.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60582024-12-20T22:36:20.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60592024-12-20T22:36:20.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60602024-12-20T22:36:20.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60612024-12-20T22:36:20.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60622024-12-20T22:36:20.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60632024-12-20T22:36:20.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60642024-12-20T22:36:20.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60652024-12-20T22:36:20.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
60662024-12-20T22:36:20.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60672024-12-20T22:36:20.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60682024-12-20T22:36:20.597ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
60692024-12-20T22:36:20.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.117223ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
60702024-12-20T22:36:20.622ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60712024-12-20T22:36:20.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60722024-12-20T22:36:20.624ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.337246ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60732024-12-20T22:36:20.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5bce95e2-429c-44ca-a5d5-f3131698e12d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60742024-12-20T22:36:20.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5bce95e2-429c-44ca-a5d5-f3131698e12d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60752024-12-20T22:36:20.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1886 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5bce95e2-429c-44ca-a5d5-f3131698e12d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60762024-12-20T22:36:21.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4c1b42ea-8093-4713-ad16-20e71bebc2d0 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60772024-12-20T22:36:21.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4c1b42ea-8093-4713-ad16-20e71bebc2d0 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60782024-12-20T22:36:21.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2000 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4c1b42ea-8093-4713-ad16-20e71bebc2d0 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60792024-12-20T22:36:22.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1e3f13ce-3fe4-4a60-9857-f9efa0705919 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60802024-12-20T22:36:22.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1e3f13ce-3fe4-4a60-9857-f9efa0705919 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60812024-12-20T22:36:22.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1e3f13ce-3fe4-4a60-9857-f9efa0705919 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60822024-12-20T22:36:23.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9b3734d0-88bc-4d77-aada-da9f84282765 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60832024-12-20T22:36:23.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9b3734d0-88bc-4d77-aada-da9f84282765 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60842024-12-20T22:36:23.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9b3734d0-88bc-4d77-aada-da9f84282765 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60852024-12-20T22:36:24.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7121bf51-7dbd-4c97-89d0-d25fdae0f1b4 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60862024-12-20T22:36:24.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7121bf51-7dbd-4c97-89d0-d25fdae0f1b4 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60872024-12-20T22:36:24.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7121bf51-7dbd-4c97-89d0-d25fdae0f1b4 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60882024-12-20T22:36:25.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 929 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 5cce5c9d-93d3-4a7f-b54a-29e64ae2e48d response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
60892024-12-20T22:36:25.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 86e5501c-9cb2-4256-8ee3-806214f35e49 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60902024-12-20T22:36:25.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 86e5501c-9cb2-4256-8ee3-806214f35e49 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60912024-12-20T22:36:25.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 86e5501c-9cb2-4256-8ee3-806214f35e49 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60922024-12-20T22:36:26.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1e45175f-b413-4d26-99a5-69933a3e47a9 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60932024-12-20T22:36:26.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1e45175f-b413-4d26-99a5-69933a3e47a9 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60942024-12-20T22:36:26.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1727 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1e45175f-b413-4d26-99a5-69933a3e47a9 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60952024-12-20T22:36:27.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b21de90f-d5f6-4bf6-b5c4-ab079b21498b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60962024-12-20T22:36:27.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b21de90f-d5f6-4bf6-b5c4-ab079b21498b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60972024-12-20T22:36:27.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b21de90f-d5f6-4bf6-b5c4-ab079b21498b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60982024-12-20T22:36:28.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0e798169-a5b5-4916-9379-504500b252b9 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
60992024-12-20T22:36:28.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0e798169-a5b5-4916-9379-504500b252b9 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
61002024-12-20T22:36:28.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2729 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0e798169-a5b5-4916-9379-504500b252b9 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
61012024-12-20T22:36:29.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 79a4c83b-5bcd-4d97-9b89-6b7b69242a7f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
61022024-12-20T22:36:29.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 79a4c83b-5bcd-4d97-9b89-6b7b69242a7f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
61032024-12-20T22:36:29.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2680 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 79a4c83b-5bcd-4d97-9b89-6b7b69242a7f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
61042024-12-20T22:36:30.571ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
61052024-12-20T22:36:30.571ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61062024-12-20T22:36:30.571ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
61072024-12-20T22:36:30.571ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
61082024-12-20T22:36:30.571ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
61092024-12-20T22:36:30.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61102024-12-20T22:36:30.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
61112024-12-20T22:36:30.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
61122024-12-20T22:36:30.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61132024-12-20T22:36:30.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61142024-12-20T22:36:30.572ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
61152024-12-20T22:36:30.572ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
61162024-12-20T22:36:30.572ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
61172024-12-20T22:36:30.572ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61182024-12-20T22:36:30.572ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61192024-12-20T22:36:30.572ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
61202024-12-20T22:36:30.572ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61212024-12-20T22:36:30.572ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
61222024-12-20T22:36:30.572ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61232024-12-20T22:36:30.572ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
61242024-12-20T22:36:30.572ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61252024-12-20T22:36:30.572ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
61262024-12-20T22:36:30.572ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
61272024-12-20T22:36:30.572ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
61282024-12-20T22:36:30.572ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61292024-12-20T22:36:30.572ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
61302024-12-20T22:36:30.572ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
61312024-12-20T22:36:30.572ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61322024-12-20T22:36:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
61332024-12-20T22:36:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
61342024-12-20T22:36:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61352024-12-20T22:36:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61362024-12-20T22:36:30.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
61372024-12-20T22:36:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
61382024-12-20T22:36:30.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61392024-12-20T22:36:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
61402024-12-20T22:36:30.573ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
61412024-12-20T22:36:30.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61422024-12-20T22:36:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61432024-12-20T22:36:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61442024-12-20T22:36:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61452024-12-20T22:36:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
61462024-12-20T22:36:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61472024-12-20T22:36:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61482024-12-20T22:36:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61492024-12-20T22:36:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61502024-12-20T22:36:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61512024-12-20T22:36:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61522024-12-20T22:36:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61532024-12-20T22:36:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
61542024-12-20T22:36:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61552024-12-20T22:36:30.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1338, tv_nsec: 186906540 } })
61562024-12-20T22:36:30.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
61572024-12-20T22:36:30.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1338, tv_nsec: 187402694 } })
61582024-12-20T22:36:30.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61592024-12-20T22:36:30.575ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
61602024-12-20T22:36:30.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61612024-12-20T22:36:30.575ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.867017ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
61622024-12-20T22:36:30.576ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61632024-12-20T22:36:30.576ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61642024-12-20T22:36:30.576ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.067532ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
61652024-12-20T22:36:30.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61662024-12-20T22:36:30.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61672024-12-20T22:36:30.579ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61682024-12-20T22:36:30.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61692024-12-20T22:36:30.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61702024-12-20T22:36:30.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
61712024-12-20T22:36:30.579ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61722024-12-20T22:36:30.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61732024-12-20T22:36:30.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
61742024-12-20T22:36:30.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61752024-12-20T22:36:30.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61762024-12-20T22:36:30.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61772024-12-20T22:36:30.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61782024-12-20T22:36:30.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61792024-12-20T22:36:30.583ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61802024-12-20T22:36:30.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61812024-12-20T22:36:30.584ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61822024-12-20T22:36:30.584ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
61832024-12-20T22:36:30.584ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61842024-12-20T22:36:30.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61852024-12-20T22:36:30.585ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61862024-12-20T22:36:30.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61872024-12-20T22:36:30.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61882024-12-20T22:36:30.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
61892024-12-20T22:36:30.588ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61902024-12-20T22:36:30.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61912024-12-20T22:36:30.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61922024-12-20T22:36:30.592ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61932024-12-20T22:36:30.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61942024-12-20T22:36:30.593ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61952024-12-20T22:36:30.593ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1338, tv_nsec: 205779771 } })
61962024-12-20T22:36:30.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61972024-12-20T22:36:30.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61982024-12-20T22:36:30.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61992024-12-20T22:36:30.593ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
62002024-12-20T22:36:30.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
62012024-12-20T22:36:30.594ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62022024-12-20T22:36:30.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62032024-12-20T22:36:30.612ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
62042024-12-20T22:36:30.612ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 39.760987ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
62052024-12-20T22:36:30.623ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62062024-12-20T22:36:30.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62072024-12-20T22:36:30.627ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62082024-12-20T22:36:30.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62092024-12-20T22:36:30.638ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62102024-12-20T22:36:30.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62112024-12-20T22:36:30.641ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62122024-12-20T22:36:30.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62132024-12-20T22:36:30.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 70.709412ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
62142024-12-20T22:36:30.648ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62152024-12-20T22:36:30.648ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62162024-12-20T22:36:30.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62172024-12-20T22:36:30.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62182024-12-20T22:36:30.651ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62192024-12-20T22:36:30.651ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 78.735943ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
62202024-12-20T22:36:30.653ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 80.242495ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
62212024-12-20T22:36:30.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62222024-12-20T22:36:30.653ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62232024-12-20T22:36:30.653ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62242024-12-20T22:36:30.654ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
62252024-12-20T22:36:30.654ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.089558ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
62262024-12-20T22:36:30.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62272024-12-20T22:36:30.654ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62282024-12-20T22:36:30.654ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
62292024-12-20T22:36:30.654ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62302024-12-20T22:36:30.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62312024-12-20T22:36:30.655ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62322024-12-20T22:36:30.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62332024-12-20T22:36:30.656ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62342024-12-20T22:36:30.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62352024-12-20T22:36:30.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62362024-12-20T22:36:30.688ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62372024-12-20T22:36:30.689ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
62382024-12-20T22:36:30.689ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62392024-12-20T22:36:30.689ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "760b8093-fcf6-44f9-9a33-b63e87715695", "content-length": "26", "date": "Fri, 20 Dec 2024 22:36:30 GMT"} })
62402024-12-20T22:36:30.689ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62412024-12-20T22:36:30.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
62422024-12-20T22:36:30.692ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62432024-12-20T22:36:30.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62442024-12-20T22:36:30.692ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62452024-12-20T22:36:30.693ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
62462024-12-20T22:36:30.693ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62472024-12-20T22:36:30.693ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "065af7a4-b269-42a2-8423-cbe7ed8ed729", "content-length": "26", "date": "Fri, 20 Dec 2024 22:36:30 GMT"} })
62482024-12-20T22:36:30.693ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62492024-12-20T22:36:30.694ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 121.474062ms iteration = 22 status = 0
62502024-12-20T22:36:30.695ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62512024-12-20T22:36:30.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 125.869464ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
62522024-12-20T22:36:30.710ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 138.036209ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62532024-12-20T22:36:30.711ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 zone_address = fd00:1122:3344:101::2
62542024-12-20T22:36:30.711ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62552024-12-20T22:36:30.711ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f59a9709-8a6a-4182-860e-5791481944d4", "content-length": "26", "date": "Fri, 20 Dec 2024 22:36:30 GMT"} })
62562024-12-20T22:36:30.711ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62572024-12-20T22:36:30.712ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
62582024-12-20T22:36:30.714ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62592024-12-20T22:36:30.714ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
62602024-12-20T22:36:30.714ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 141.469864ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
62612024-12-20T22:36:30.718ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 145.644329ms iteration = 25 status = {"physical_disks_added":0}
62622024-12-20T22:36:30.760ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
62632024-12-20T22:36:30.760ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62642024-12-20T22:36:30.760ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d16a02cf-cd20-443d-9c51-0bb15d3b4c96", "content-length": "372", "date": "Fri, 20 Dec 2024 22:36:30 GMT"} })
62652024-12-20T22:36:30.760ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62662024-12-20T22:36:30.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62672024-12-20T22:36:30.781ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 209.916873ms iteration = 22 status = {}
62682024-12-20T22:36:30.782ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
62692024-12-20T22:36:30.783ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1387abf1-138e-46a6-bf31-3f5b3d619cf8", "content-length": "1", "date": "Fri, 20 Dec 2024 22:36:30 GMT"} })
62702024-12-20T22:36:30.784ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62712024-12-20T22:36:30.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62722024-12-20T22:36:30.786ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 215.097395ms iteration = 22 status = null
62732024-12-20T22:36:30.798ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62742024-12-20T22:36:30.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62752024-12-20T22:36:30.800ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62762024-12-20T22:36:30.802ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62772024-12-20T22:36:30.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62782024-12-20T22:36:30.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62792024-12-20T22:36:30.804ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62802024-12-20T22:36:30.806ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62812024-12-20T22:36:30.806ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62822024-12-20T22:36:30.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62832024-12-20T22:36:30.828ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
62842024-12-20T22:36:30.828ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
62852024-12-20T22:36:30.829ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "242ddc2f-a7d2-4870-aca6-08ddc09e11b1", "date": "Fri, 20 Dec 2024 22:36:30 GMT"} })
62862024-12-20T22:36:30.829ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62872024-12-20T22:36:30.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62882024-12-20T22:36:30.831ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62892024-12-20T22:36:30.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62902024-12-20T22:36:30.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62912024-12-20T22:36:30.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62922024-12-20T22:36:30.837ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
62932024-12-20T22:36:30.837ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62942024-12-20T22:36:30.838ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1b18295f-6141-471f-aaa2-ee6886480e84", "date": "Fri, 20 Dec 2024 22:36:30 GMT"} })
62952024-12-20T22:36:30.840ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 267.383399ms iteration = 22 status = {}
62962024-12-20T22:36:30.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62972024-12-20T22:36:30.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62982024-12-20T22:36:30.852ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9fedf0d4-8a86-4506-bf93-224faabd5e37, rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b26f0563-25fb-4d7c-8480-dd368ac01105) } rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
62992024-12-20T22:36:30.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63002024-12-20T22:36:30.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63012024-12-20T22:36:30.861ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
63022024-12-20T22:36:30.862ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "dacaa721-00ad-4625-aeef-07e0d9260529", "content-length": "134", "date": "Fri, 20 Dec 2024 22:36:30 GMT"} })
63032024-12-20T22:36:30.862ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
63042024-12-20T22:36:30.862ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b26f0563-25fb-4d7c-8480-dd368ac01105
63052024-12-20T22:36:30.862ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
63062024-12-20T22:36:30.862ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63072024-12-20T22:36:30.862ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63082024-12-20T22:36:30.862ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63092024-12-20T22:36:30.862ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63102024-12-20T22:36:30.862ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63112024-12-20T22:36:30.862ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63122024-12-20T22:36:30.862ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63132024-12-20T22:36:30.863ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
63142024-12-20T22:36:30.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63152024-12-20T22:36:30.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63162024-12-20T22:36:30.865ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
63172024-12-20T22:36:30.865ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fd8af64-a931-4392-bb11-bd58fbc5da58", "content-length": "2", "date": "Fri, 20 Dec 2024 22:36:30 GMT"} })
63182024-12-20T22:36:30.865ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
63192024-12-20T22:36:30.865ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "78230cf0-f4d6-4ceb-bc8d-85c1c0659695", "content-length": "52", "date": "Fri, 20 Dec 2024 22:36:30 GMT"} })
63202024-12-20T22:36:30.865ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
63212024-12-20T22:36:30.865ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
63222024-12-20T22:36:30.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = be8e69e9-1573-4648-a858-c35c1c485e60 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
63232024-12-20T22:36:30.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = be8e69e9-1573-4648-a858-c35c1c485e60 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
63242024-12-20T22:36:30.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = be8e69e9-1573-4648-a858-c35c1c485e60 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
63252024-12-20T22:36:30.934ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
63262024-12-20T22:36:30.970ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "64fc94da-88ee-4e6a-a327-9996ec0934d9", "date": "Fri, 20 Dec 2024 22:36:30 GMT"} })
63272024-12-20T22:36:30.970ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch = Switch0
63282024-12-20T22:36:30.970ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
63292024-12-20T22:36:30.971ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3820f36f-c449-4367-bdb2-2b41429538bf", "content-length": "691", "date": "Fri, 20 Dec 2024 22:36:30 GMT"} })
63302024-12-20T22:36:30.971ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
63312024-12-20T22:36:30.971ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
63322024-12-20T22:36:30.971ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
63332024-12-20T22:36:30.971ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f36a94bd-ca50-41d4-9408-b837b16525f7", "content-length": "682", "date": "Fri, 20 Dec 2024 22:36:30 GMT"} })
63342024-12-20T22:36:30.971ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63352024-12-20T22:36:30.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63362024-12-20T22:36:30.972ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 399.167356ms iteration = 22 status = {}
63372024-12-20T22:36:30.975ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63382024-12-20T22:36:30.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63392024-12-20T22:36:30.978ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63402024-12-20T22:36:30.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63412024-12-20T22:36:30.980ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63422024-12-20T22:36:30.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63432024-12-20T22:36:30.987ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 414.587521ms iteration = 22 status = {}
63442024-12-20T22:36:31.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5ea8383b-b99c-4aac-ae64-7dd14d78b6da roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63452024-12-20T22:36:31.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5ea8383b-b99c-4aac-ae64-7dd14d78b6da resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63462024-12-20T22:36:31.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5ea8383b-b99c-4aac-ae64-7dd14d78b6da response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63472024-12-20T22:36:32.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e1bf67cd-842f-491e-8fac-ae49f6a8ae4a roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63482024-12-20T22:36:32.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e1bf67cd-842f-491e-8fac-ae49f6a8ae4a resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63492024-12-20T22:36:32.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e1bf67cd-842f-491e-8fac-ae49f6a8ae4a response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63502024-12-20T22:36:33.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8219e751-a025-4aff-a7df-d500d95ab96c roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63512024-12-20T22:36:33.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8219e751-a025-4aff-a7df-d500d95ab96c resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63522024-12-20T22:36:33.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2577 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8219e751-a025-4aff-a7df-d500d95ab96c response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63532024-12-20T22:36:34.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 81827116-827b-48d8-b0bd-deac5a9d7f85 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63542024-12-20T22:36:34.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 81827116-827b-48d8-b0bd-deac5a9d7f85 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63552024-12-20T22:36:34.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1475 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 81827116-827b-48d8-b0bd-deac5a9d7f85 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63562024-12-20T22:36:35.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d936bd7b-7543-4208-9ca4-c1b4b80af0b7 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63572024-12-20T22:36:35.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d936bd7b-7543-4208-9ca4-c1b4b80af0b7 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63582024-12-20T22:36:35.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d936bd7b-7543-4208-9ca4-c1b4b80af0b7 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63592024-12-20T22:36:35.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 179edfaf-191f-48f5-a697-16e254a8a226 roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
63602024-12-20T22:36:35.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 179edfaf-191f-48f5-a697-16e254a8a226 resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
63612024-12-20T22:36:35.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 179edfaf-191f-48f5-a697-16e254a8a226 response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
63622024-12-20T22:36:35.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = f16b7192-af2f-4b59-a8a3-fdfb0ccb8b18 roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
63632024-12-20T22:36:35.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = f16b7192-af2f-4b59-a8a3-fdfb0ccb8b18 resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
63642024-12-20T22:36:35.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = f16b7192-af2f-4b59-a8a3-fdfb0ccb8b18 response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
63652024-12-20T22:36:35.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 607 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = c8901c46-2663-45f3-bed1-cbba75b4e976 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
63662024-12-20T22:36:36.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 841d335f-fcd2-47a7-a6a5-f5b0418f1d29 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63672024-12-20T22:36:36.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 841d335f-fcd2-47a7-a6a5-f5b0418f1d29 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63682024-12-20T22:36:36.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 841d335f-fcd2-47a7-a6a5-f5b0418f1d29 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63692024-12-20T22:36:37.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 85affee3-3b5f-4b69-bfc1-d1fbd8d0c60c roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63702024-12-20T22:36:37.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 85affee3-3b5f-4b69-bfc1-d1fbd8d0c60c resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63712024-12-20T22:36:37.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2511 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 85affee3-3b5f-4b69-bfc1-d1fbd8d0c60c response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63722024-12-20T22:36:38.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 98dc0260-1416-4db3-afaa-134418bc284b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63732024-12-20T22:36:38.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 98dc0260-1416-4db3-afaa-134418bc284b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63742024-12-20T22:36:38.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 98dc0260-1416-4db3-afaa-134418bc284b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63752024-12-20T22:36:39.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4989a466-685b-4674-b8b6-eb8626ccf778 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63762024-12-20T22:36:39.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4989a466-685b-4674-b8b6-eb8626ccf778 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63772024-12-20T22:36:39.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4989a466-685b-4674-b8b6-eb8626ccf778 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63782024-12-20T22:36:40.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1b88bee9-a69e-4f25-9703-03a38fe03740 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63792024-12-20T22:36:40.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1b88bee9-a69e-4f25-9703-03a38fe03740 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63802024-12-20T22:36:40.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2656 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1b88bee9-a69e-4f25-9703-03a38fe03740 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
63812024-12-20T22:36:40.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
63822024-12-20T22:36:40.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63832024-12-20T22:36:40.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63842024-12-20T22:36:40.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
63852024-12-20T22:36:40.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63862024-12-20T22:36:40.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63872024-12-20T22:36:40.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63882024-12-20T22:36:40.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63892024-12-20T22:36:40.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63902024-12-20T22:36:40.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63912024-12-20T22:36:40.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63922024-12-20T22:36:40.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63932024-12-20T22:36:40.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63942024-12-20T22:36:40.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63952024-12-20T22:36:40.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63962024-12-20T22:36:40.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
63972024-12-20T22:36:40.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63982024-12-20T22:36:40.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63992024-12-20T22:36:40.595ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
64002024-12-20T22:36:40.595ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.82638ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
64012024-12-20T22:36:40.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 42.685898ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64022024-12-20T22:36:41.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2370c1fc-0945-44d2-b8c5-93b9e524aaf1 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64032024-12-20T22:36:41.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2370c1fc-0945-44d2-b8c5-93b9e524aaf1 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64042024-12-20T22:36:41.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2370c1fc-0945-44d2-b8c5-93b9e524aaf1 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64052024-12-20T22:36:42.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cc6769bf-5745-4c6a-9072-7b37dac3b770 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64062024-12-20T22:36:42.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cc6769bf-5745-4c6a-9072-7b37dac3b770 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64072024-12-20T22:36:42.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cc6769bf-5745-4c6a-9072-7b37dac3b770 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64082024-12-20T22:36:43.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4f609ebe-3154-4883-a7b2-2c44b17a58ae roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64092024-12-20T22:36:43.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4f609ebe-3154-4883-a7b2-2c44b17a58ae resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64102024-12-20T22:36:43.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1958 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4f609ebe-3154-4883-a7b2-2c44b17a58ae response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64112024-12-20T22:36:44.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8537eb64-28e9-4f65-ad05-48ad77039d11 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64122024-12-20T22:36:44.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8537eb64-28e9-4f65-ad05-48ad77039d11 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64132024-12-20T22:36:44.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8537eb64-28e9-4f65-ad05-48ad77039d11 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64142024-12-20T22:36:45.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 621 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 596ad49e-79b1-452a-ad50-88fa41976506 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
64152024-12-20T22:36:45.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 79023545-9603-4daa-bce4-3704b911f167 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64162024-12-20T22:36:45.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 79023545-9603-4daa-bce4-3704b911f167 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64172024-12-20T22:36:45.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 79023545-9603-4daa-bce4-3704b911f167 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64182024-12-20T22:36:46.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c7de00e8-6d0b-4b32-979b-0002b4a12da5 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64192024-12-20T22:36:46.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c7de00e8-6d0b-4b32-979b-0002b4a12da5 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64202024-12-20T22:36:46.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1919 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c7de00e8-6d0b-4b32-979b-0002b4a12da5 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64212024-12-20T22:36:47.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b2871b40-c3c3-4925-9f23-c39315258e4a roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64222024-12-20T22:36:47.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b2871b40-c3c3-4925-9f23-c39315258e4a resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64232024-12-20T22:36:47.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b2871b40-c3c3-4925-9f23-c39315258e4a response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64242024-12-20T22:36:48.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 51e6c308-2a20-4f1e-ba52-69cde0c3c380 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64252024-12-20T22:36:48.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 51e6c308-2a20-4f1e-ba52-69cde0c3c380 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64262024-12-20T22:36:48.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 51e6c308-2a20-4f1e-ba52-69cde0c3c380 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64272024-12-20T22:36:49.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8e30f6b3-710e-4eac-b3d1-781aa7d7f99b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64282024-12-20T22:36:49.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8e30f6b3-710e-4eac-b3d1-781aa7d7f99b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64292024-12-20T22:36:49.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8e30f6b3-710e-4eac-b3d1-781aa7d7f99b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64302024-12-20T22:36:50.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 33ff78f7-7b4b-4e28-851a-2cd9090e280b roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
64312024-12-20T22:36:50.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 33ff78f7-7b4b-4e28-851a-2cd9090e280b resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
64322024-12-20T22:36:50.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3720 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 33ff78f7-7b4b-4e28-851a-2cd9090e280b response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
64332024-12-20T22:36:50.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 8a3c7373-609a-4868-93e8-8561b6131bc2 roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
64342024-12-20T22:36:50.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 8a3c7373-609a-4868-93e8-8561b6131bc2 resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
64352024-12-20T22:36:50.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 8a3c7373-609a-4868-93e8-8561b6131bc2 response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
64362024-12-20T22:36:50.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0ec11585-9dac-4851-9b11-ca0aa922700f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64372024-12-20T22:36:50.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0ec11585-9dac-4851-9b11-ca0aa922700f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64382024-12-20T22:36:50.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1889 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0ec11585-9dac-4851-9b11-ca0aa922700f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64392024-12-20T22:36:50.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
64402024-12-20T22:36:50.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64412024-12-20T22:36:50.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64422024-12-20T22:36:50.572ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
64432024-12-20T22:36:50.572ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64442024-12-20T22:36:50.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64452024-12-20T22:36:50.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64462024-12-20T22:36:50.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64472024-12-20T22:36:50.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64482024-12-20T22:36:50.576ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.919428ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64492024-12-20T22:36:50.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64502024-12-20T22:36:50.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64512024-12-20T22:36:50.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64522024-12-20T22:36:50.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64532024-12-20T22:36:50.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64542024-12-20T22:36:50.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64552024-12-20T22:36:50.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
64562024-12-20T22:36:50.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64572024-12-20T22:36:50.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64582024-12-20T22:36:50.591ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
64592024-12-20T22:36:50.591ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.358764ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
64602024-12-20T22:36:51.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fdd4eb48-ef1b-4c05-a46c-bd0acb3b9366 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64612024-12-20T22:36:51.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fdd4eb48-ef1b-4c05-a46c-bd0acb3b9366 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64622024-12-20T22:36:51.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fdd4eb48-ef1b-4c05-a46c-bd0acb3b9366 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64632024-12-20T22:36:52.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e06453b6-dec7-47db-b829-ea85a0c921c9 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64642024-12-20T22:36:52.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e06453b6-dec7-47db-b829-ea85a0c921c9 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64652024-12-20T22:36:52.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e06453b6-dec7-47db-b829-ea85a0c921c9 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64662024-12-20T22:36:53.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0d99777e-4a86-467d-a45c-7f0fdf29403f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64672024-12-20T22:36:53.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0d99777e-4a86-467d-a45c-7f0fdf29403f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64682024-12-20T22:36:53.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0d99777e-4a86-467d-a45c-7f0fdf29403f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64692024-12-20T22:36:54.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d62f6e6c-d0ad-401f-b8a8-1966aa900240 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64702024-12-20T22:36:54.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d62f6e6c-d0ad-401f-b8a8-1966aa900240 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64712024-12-20T22:36:54.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d62f6e6c-d0ad-401f-b8a8-1966aa900240 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64722024-12-20T22:36:55.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 802 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 91b48d67-e2c7-4115-8b87-5a2e0aa78f5c response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
64732024-12-20T22:36:55.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1bc8d9aa-8b06-4809-9db6-60124c77c768 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64742024-12-20T22:36:55.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1bc8d9aa-8b06-4809-9db6-60124c77c768 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64752024-12-20T22:36:55.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1bc8d9aa-8b06-4809-9db6-60124c77c768 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64762024-12-20T22:36:56.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = eab47399-b81a-49fa-86db-2029a6627899 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64772024-12-20T22:36:56.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = eab47399-b81a-49fa-86db-2029a6627899 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64782024-12-20T22:36:56.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2681 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = eab47399-b81a-49fa-86db-2029a6627899 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64792024-12-20T22:36:57.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = aefdfbc9-8e69-4d86-ab34-8b567b34c086 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64802024-12-20T22:36:57.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = aefdfbc9-8e69-4d86-ab34-8b567b34c086 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64812024-12-20T22:36:57.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = aefdfbc9-8e69-4d86-ab34-8b567b34c086 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64822024-12-20T22:36:58.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1389a930-893c-4085-a84e-b26f7aaf107c roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64832024-12-20T22:36:58.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1389a930-893c-4085-a84e-b26f7aaf107c resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64842024-12-20T22:36:58.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1389a930-893c-4085-a84e-b26f7aaf107c response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64852024-12-20T22:36:59.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2318eaad-28ed-4134-8106-460edbd33c1d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64862024-12-20T22:36:59.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2318eaad-28ed-4134-8106-460edbd33c1d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64872024-12-20T22:36:59.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3603 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2318eaad-28ed-4134-8106-460edbd33c1d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
64882024-12-20T22:37:00.571ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
64892024-12-20T22:37:00.571ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
64902024-12-20T22:37:00.571ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
64912024-12-20T22:37:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
64922024-12-20T22:37:00.571ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64932024-12-20T22:37:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
64942024-12-20T22:37:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
64952024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
64962024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
64972024-12-20T22:37:00.572ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:27:00.571871777 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
64982024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64992024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
65002024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
65012024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
65022024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
65032024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
65042024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65052024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
65062024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
65072024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65082024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
65092024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65102024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
65112024-12-20T22:37:00.572ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e
65122024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.221\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e"}
65132024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
65142024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65152024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65162024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
65172024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65182024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65192024-12-20T22:37:00.572ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b172144-6fe3-403a-b88e-6be93db6788c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e1e925bb-4266-49d2-b532-0f79860badbb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9d7e78a-d944-4f23-9be0-86e0f1334a43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9d7e78a-d944-4f23-9be0-86e0f1334a43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1368, tv_nsec: 185138361 } })
65202024-12-20T22:37:00.572ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bcf7579-f08c-458a-b8fa-486beafab77e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c65750e1-e505-4d05-b242-145c69974016.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c65750e1-e505-4d05-b242-145c69974016.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1368, tv_nsec: 185161372 } })
65212024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65222024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
65232024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65242024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
65252024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65262024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
65272024-12-20T22:37:00.572ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
65282024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65292024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
65302024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
65312024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65322024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65332024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
65342024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
65352024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65362024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
65372024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65382024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65392024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
65402024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65412024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65422024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
65432024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
65442024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65452024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
65462024-12-20T22:37:00.573ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
65472024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
65482024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65492024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
65502024-12-20T22:37:00.573ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
65512024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65522024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
65532024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
65542024-12-20T22:37:00.573ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
65552024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
65562024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
65572024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
65582024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
65592024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65602024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
65612024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65622024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65632024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
65642024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
65652024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
65662024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
65672024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65682024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65692024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
65702024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65712024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
65722024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
65732024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65742024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65752024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65762024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
65772024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.727025ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
65782024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
65792024-12-20T22:37:00.574ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.664064ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
65802024-12-20T22:37:00.577ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65812024-12-20T22:37:00.578ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1368, tv_nsec: 190674834 } })
65822024-12-20T22:37:00.578ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
65832024-12-20T22:37:00.578ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65842024-12-20T22:37:00.578ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1368, tv_nsec: 191242409 } })
65852024-12-20T22:37:00.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65862024-12-20T22:37:00.578ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.903811ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
65872024-12-20T22:37:00.579ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
65882024-12-20T22:37:00.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65892024-12-20T22:37:00.580ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:27:00.571871777 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
65902024-12-20T22:37:00.580ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.367881ms iteration = 12 status = {"expiration":"2024-12-20T22:27:00.571871777Z","pruned":[]}
65912024-12-20T22:37:00.580ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
65922024-12-20T22:37:00.580ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65932024-12-20T22:37:00.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65942024-12-20T22:37:00.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65952024-12-20T22:37:00.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65962024-12-20T22:37:00.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65972024-12-20T22:37:00.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65982024-12-20T22:37:00.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65992024-12-20T22:37:00.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66002024-12-20T22:37:00.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66012024-12-20T22:37:00.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66022024-12-20T22:37:00.585ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
66032024-12-20T22:37:00.585ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
66042024-12-20T22:37:00.585ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 12.372861ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
66052024-12-20T22:37:00.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
66062024-12-20T22:37:00.586ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66072024-12-20T22:37:00.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66082024-12-20T22:37:00.588ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.779358ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
66092024-12-20T22:37:00.588ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66102024-12-20T22:37:00.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
66112024-12-20T22:37:00.590ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
66122024-12-20T22:37:00.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
66132024-12-20T22:37:00.590ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66142024-12-20T22:37:00.591ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.04313ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
66152024-12-20T22:37:00.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
66162024-12-20T22:37:00.592ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66172024-12-20T22:37:00.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66182024-12-20T22:37:00.594ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66192024-12-20T22:37:00.596ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66202024-12-20T22:37:00.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66212024-12-20T22:37:00.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66222024-12-20T22:37:00.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66232024-12-20T22:37:00.598ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66242024-12-20T22:37:00.598ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66252024-12-20T22:37:00.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66262024-12-20T22:37:00.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66272024-12-20T22:37:00.600ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1368, tv_nsec: 212733473 } })
66282024-12-20T22:37:00.600ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
66292024-12-20T22:37:00.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
66302024-12-20T22:37:00.604ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
66312024-12-20T22:37:00.604ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
66322024-12-20T22:37:00.604ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
66332024-12-20T22:37:00.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66342024-12-20T22:37:00.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66352024-12-20T22:37:00.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66362024-12-20T22:37:00.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66372024-12-20T22:37:00.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
66382024-12-20T22:37:00.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66392024-12-20T22:37:00.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66402024-12-20T22:37:00.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
66412024-12-20T22:37:00.610ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66422024-12-20T22:37:00.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66432024-12-20T22:37:00.613ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
66442024-12-20T22:37:00.613ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 0 version = 2
66452024-12-20T22:37:00.613ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66462024-12-20T22:37:00.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66472024-12-20T22:37:00.615ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66482024-12-20T22:37:00.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
66492024-12-20T22:37:00.619ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66502024-12-20T22:37:00.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66512024-12-20T22:37:00.621ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 1 version = 2
66522024-12-20T22:37:00.621ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
66532024-12-20T22:37:00.621ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:26:40.428768 UTC dns_group = external generation = 2
66542024-12-20T22:37:00.621ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 49.679161ms iteration = 12 status = {"generation":2}
66552024-12-20T22:37:00.630ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
66562024-12-20T22:37:00.631ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.936426ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
66572024-12-20T22:37:00.631ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66582024-12-20T22:37:00.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66592024-12-20T22:37:00.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66602024-12-20T22:37:00.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66612024-12-20T22:37:00.635ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66622024-12-20T22:37:00.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66632024-12-20T22:37:00.636ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66642024-12-20T22:37:00.637ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66652024-12-20T22:37:00.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66662024-12-20T22:37:00.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
66672024-12-20T22:37:00.639ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66682024-12-20T22:37:00.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66692024-12-20T22:37:00.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 67.824532ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
66702024-12-20T22:37:00.642ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 69.145548ms iteration = 23 status = 0
66712024-12-20T22:37:00.645ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66722024-12-20T22:37:00.645ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
66732024-12-20T22:37:00.645ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66742024-12-20T22:37:00.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66752024-12-20T22:37:00.648ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66762024-12-20T22:37:00.648ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66772024-12-20T22:37:00.648ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
66782024-12-20T22:37:00.648ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66792024-12-20T22:37:00.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66802024-12-20T22:37:00.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66812024-12-20T22:37:00.651ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66822024-12-20T22:37:00.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66832024-12-20T22:37:00.652ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 80.029318ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66842024-12-20T22:37:00.655ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66852024-12-20T22:37:00.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66862024-12-20T22:37:00.656ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66872024-12-20T22:37:00.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66882024-12-20T22:37:00.659ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66892024-12-20T22:37:00.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66902024-12-20T22:37:00.661ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66912024-12-20T22:37:00.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66922024-12-20T22:37:00.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 95.219088ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66932024-12-20T22:37:00.668ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66942024-12-20T22:37:00.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 94.632592ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
66952024-12-20T22:37:00.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
66962024-12-20T22:37:00.670ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66972024-12-20T22:37:00.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66982024-12-20T22:37:00.671ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66992024-12-20T22:37:00.671ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67002024-12-20T22:37:00.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67012024-12-20T22:37:00.672ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67022024-12-20T22:37:00.673ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67032024-12-20T22:37:00.673ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67042024-12-20T22:37:00.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67052024-12-20T22:37:00.673ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 99.407223ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
67062024-12-20T22:37:00.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
67072024-12-20T22:37:00.675ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67082024-12-20T22:37:00.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67092024-12-20T22:37:00.675ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
67102024-12-20T22:37:00.675ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
67112024-12-20T22:37:00.675ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
67122024-12-20T22:37:00.675ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67132024-12-20T22:37:00.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67142024-12-20T22:37:00.676ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
67152024-12-20T22:37:00.676ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
67162024-12-20T22:37:00.676ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 103.048044ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
67172024-12-20T22:37:00.676ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67182024-12-20T22:37:00.678ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67192024-12-20T22:37:00.678ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
67202024-12-20T22:37:00.678ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 104.453513ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
67212024-12-20T22:37:00.679ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67222024-12-20T22:37:00.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67232024-12-20T22:37:00.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67242024-12-20T22:37:00.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67252024-12-20T22:37:00.680ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67262024-12-20T22:37:00.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67272024-12-20T22:37:00.683ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
67282024-12-20T22:37:00.683ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
67292024-12-20T22:37:00.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67302024-12-20T22:37:00.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67312024-12-20T22:37:00.685ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67322024-12-20T22:37:00.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67332024-12-20T22:37:00.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67342024-12-20T22:37:00.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67352024-12-20T22:37:00.690ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
67362024-12-20T22:37:00.690ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
67372024-12-20T22:37:00.690ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:26:39.700273 UTC dns_group = internal generation = 1
67382024-12-20T22:37:00.690ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 118.715267ms iteration = 12 status = {"generation":1}
67392024-12-20T22:37:00.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 423495eb-7836-4f96-a778-c94983f3d1cf roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
67402024-12-20T22:37:00.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 423495eb-7836-4f96-a778-c94983f3d1cf resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
67412024-12-20T22:37:00.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1844 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 423495eb-7836-4f96-a778-c94983f3d1cf response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
67422024-12-20T22:37:00.702ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
67432024-12-20T22:37:00.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
67442024-12-20T22:37:00.707ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
67452024-12-20T22:37:00.710ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
67462024-12-20T22:37:00.711ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67472024-12-20T22:37:00.711ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
67482024-12-20T22:37:00.711ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 137.947467ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
67492024-12-20T22:37:00.730ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67502024-12-20T22:37:00.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67512024-12-20T22:37:00.732ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67522024-12-20T22:37:00.734ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
67532024-12-20T22:37:00.734ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67542024-12-20T22:37:00.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67552024-12-20T22:37:00.748ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 zone_address = fd00:1122:3344:101::2
67562024-12-20T22:37:00.748ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67572024-12-20T22:37:00.748ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "89913e07-5296-4367-8ac1-159d7b0929ec", "content-length": "26", "date": "Fri, 20 Dec 2024 22:37:00 GMT"} })
67582024-12-20T22:37:00.748ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67592024-12-20T22:37:00.750ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
67602024-12-20T22:37:00.771ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67612024-12-20T22:37:00.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67622024-12-20T22:37:00.788ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:25:57.040586Z, time_modified: 2024-12-20T22:25:57.040586Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }) }
67632024-12-20T22:37:00.788ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 216.872505ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]}},"default_endpoint":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
67642024-12-20T22:37:00.822ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 248.996382ms iteration = 26 status = {"physical_disks_added":0}
67652024-12-20T22:37:00.842ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67662024-12-20T22:37:00.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67672024-12-20T22:37:00.846ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
67682024-12-20T22:37:00.846ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 272.207772ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
67692024-12-20T22:37:00.861ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
67702024-12-20T22:37:00.861ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67712024-12-20T22:37:00.861ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a0863ef-7e09-48f7-befb-bb41a7fd5906", "content-length": "26", "date": "Fri, 20 Dec 2024 22:37:00 GMT"} })
67722024-12-20T22:37:00.861ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67732024-12-20T22:37:00.862ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
67742024-12-20T22:37:00.862ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67752024-12-20T22:37:00.863ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb34158b-f08a-4ab7-b183-40929f3d6942", "content-length": "26", "date": "Fri, 20 Dec 2024 22:37:00 GMT"} })
67762024-12-20T22:37:00.863ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67772024-12-20T22:37:00.867ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67782024-12-20T22:37:00.868ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67792024-12-20T22:37:00.885ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
67802024-12-20T22:37:00.886ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "21d8b29c-57ef-4679-9435-94d54e66ba2f", "date": "Fri, 20 Dec 2024 22:37:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67812024-12-20T22:37:00.886ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67822024-12-20T22:37:00.887ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ccf738b4-0329-42ec-be31-cf3357c9de0b", "date": "Fri, 20 Dec 2024 22:37:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67832024-12-20T22:37:00.887ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67842024-12-20T22:37:00.889ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67852024-12-20T22:37:00.889ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 317.379299ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
67862024-12-20T22:37:00.892ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
67872024-12-20T22:37:00.915ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
67882024-12-20T22:37:00.915ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67892024-12-20T22:37:00.916ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b97375b-5c8d-452d-b85d-80f07bdcc7b0", "content-length": "372", "date": "Fri, 20 Dec 2024 22:37:00 GMT"} })
67902024-12-20T22:37:00.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67912024-12-20T22:37:00.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67922024-12-20T22:37:00.917ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67932024-12-20T22:37:00.918ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67942024-12-20T22:37:00.918ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67952024-12-20T22:37:00.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67962024-12-20T22:37:00.920ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67972024-12-20T22:37:00.922ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67982024-12-20T22:37:00.922ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67992024-12-20T22:37:00.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68002024-12-20T22:37:00.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = a2a6339a-f402-4849-b10a-a452151e4329 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
68012024-12-20T22:37:00.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = a2a6339a-f402-4849-b10a-a452151e4329 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
68022024-12-20T22:37:00.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = a2a6339a-f402-4849-b10a-a452151e4329 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
68032024-12-20T22:37:00.975ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
68042024-12-20T22:37:00.975ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
68052024-12-20T22:37:00.975ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "acce30d5-b406-4af4-975d-8a60dc97134a", "date": "Fri, 20 Dec 2024 22:37:00 GMT"} })
68062024-12-20T22:37:00.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68072024-12-20T22:37:00.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68082024-12-20T22:37:00.978ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68092024-12-20T22:37:00.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68102024-12-20T22:37:00.981ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68112024-12-20T22:37:00.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68122024-12-20T22:37:00.985ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
68132024-12-20T22:37:00.985ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68142024-12-20T22:37:00.985ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "17b15729-690c-4eda-aa79-ffccba2f86d6", "date": "Fri, 20 Dec 2024 22:37:00 GMT"} })
68152024-12-20T22:37:00.987ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 413.417368ms iteration = 23 status = {}
68162024-12-20T22:37:01.020ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
68172024-12-20T22:37:01.020ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c32e0b66-857f-42b9-b395-4c7c4e509fde", "content-length": "1", "date": "Fri, 20 Dec 2024 22:37:00 GMT"} })
68182024-12-20T22:37:01.020ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
68192024-12-20T22:37:01.021ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "06e01b3d-4b2d-49a2-966f-7d7fe8d4b089", "date": "Fri, 20 Dec 2024 22:37:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
68202024-12-20T22:37:01.021ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
68212024-12-20T22:37:01.023ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68222024-12-20T22:37:01.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68232024-12-20T22:37:01.024ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "590f6d3b-dcfb-40a4-80f7-4f513be71669", "date": "Fri, 20 Dec 2024 22:37:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
68242024-12-20T22:37:01.024ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
68252024-12-20T22:37:01.026ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d721086f-71d2-499d-a61c-0af9f839f314", "date": "Fri, 20 Dec 2024 22:37:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
68262024-12-20T22:37:01.026ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
68272024-12-20T22:37:01.028ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
68282024-12-20T22:37:01.028ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 456.455266ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
68292024-12-20T22:37:01.060ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 489.144978ms iteration = 23 status = {}
68302024-12-20T22:37:01.072ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
68312024-12-20T22:37:01.072ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3ee55a0-4572-449b-938a-24883ef58d40", "content-length": "691", "date": "Fri, 20 Dec 2024 22:37:00 GMT"} })
68322024-12-20T22:37:01.072ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
68332024-12-20T22:37:01.073ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
68342024-12-20T22:37:01.073ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
68352024-12-20T22:37:01.074ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 502.810656ms iteration = 23 status = null
68362024-12-20T22:37:01.075ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 501.194701ms iteration = 23 status = {}
68372024-12-20T22:37:01.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68382024-12-20T22:37:01.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68392024-12-20T22:37:01.088ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9fedf0d4-8a86-4506-bf93-224faabd5e37, rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b26f0563-25fb-4d7c-8480-dd368ac01105) } rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
68402024-12-20T22:37:01.088ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68412024-12-20T22:37:01.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68422024-12-20T22:37:01.097ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
68432024-12-20T22:37:01.098ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "11868fa9-7129-44a3-9f1f-7543f7affd7e", "content-length": "134", "date": "Fri, 20 Dec 2024 22:37:00 GMT"} })
68442024-12-20T22:37:01.098ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
68452024-12-20T22:37:01.098ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b26f0563-25fb-4d7c-8480-dd368ac01105
68462024-12-20T22:37:01.098ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
68472024-12-20T22:37:01.098ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
68482024-12-20T22:37:01.098ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68492024-12-20T22:37:01.098ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68502024-12-20T22:37:01.098ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68512024-12-20T22:37:01.098ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68522024-12-20T22:37:01.098ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68532024-12-20T22:37:01.098ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68542024-12-20T22:37:01.098ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
68552024-12-20T22:37:01.098ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68562024-12-20T22:37:01.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68572024-12-20T22:37:01.100ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
68582024-12-20T22:37:01.100ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b13203e-7110-45f3-9696-5841f64540a9", "content-length": "2", "date": "Fri, 20 Dec 2024 22:37:00 GMT"} })
68592024-12-20T22:37:01.100ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
68602024-12-20T22:37:01.101ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "07c335e6-2635-4d25-b739-a96f772414b5", "content-length": "52", "date": "Fri, 20 Dec 2024 22:37:00 GMT"} })
68612024-12-20T22:37:01.101ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
68622024-12-20T22:37:01.101ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
68632024-12-20T22:37:01.199ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0af06281-195d-49b1-884b-aa2e84f59afc", "date": "Fri, 20 Dec 2024 22:37:01 GMT"} })
68642024-12-20T22:37:01.199ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch = Switch0
68652024-12-20T22:37:01.199ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
68662024-12-20T22:37:01.200ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "221361c0-986c-4784-be85-c9ad9d3fa7ac", "content-length": "682", "date": "Fri, 20 Dec 2024 22:37:01 GMT"} })
68672024-12-20T22:37:01.200ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68682024-12-20T22:37:01.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68692024-12-20T22:37:01.204ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68702024-12-20T22:37:01.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68712024-12-20T22:37:01.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68722024-12-20T22:37:01.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68732024-12-20T22:37:01.210ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68742024-12-20T22:37:01.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68752024-12-20T22:37:01.216ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 642.878132ms iteration = 23 status = {}
68762024-12-20T22:37:01.361ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
68772024-12-20T22:37:01.361ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
68782024-12-20T22:37:01.392ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
68792024-12-20T22:37:01.392ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:55169
68802024-12-20T22:37:01.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:55169 req_id = 61e5c7d9-4f18-49e5-822e-c1a68e2f7190 roles = RoleSet { roles: {} } uri = /metrics/producers
68812024-12-20T22:37:01.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:55169 req_id = 61e5c7d9-4f18-49e5-822e-c1a68e2f7190 resource = Database result = Ok(()) uri = /metrics/producers
68822024-12-20T22:37:01.448ZINFOnexus: assigned collector to new producer collector_id = a0c68cf7-84ce-4a59-a3f9-ff7d332963b9 file = nexus/src/app/oximeter.rs:76 producer_id = c08fb79e-9df2-49bb-be41-3925df103e75
68832024-12-20T22:37:01.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56346 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:55169 req_id = 61e5c7d9-4f18-49e5-822e-c1a68e2f7190 response_code = 201 uri = /metrics/producers
68842024-12-20T22:37:01.448ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "61e5c7d9-4f18-49e5-822e-c1a68e2f7190", "content-length": "41", "date": "Fri, 20 Dec 2024 22:37:01 GMT"} })
68852024-12-20T22:37:01.450ZDEBGnexus (producer-registration-task): registered with nexus successfully
68862024-12-20T22:37:01.450ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
68872024-12-20T22:37:01.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 03ea3515-8487-4760-80cf-a50af840be00 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
68882024-12-20T22:37:01.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 03ea3515-8487-4760-80cf-a50af840be00 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
68892024-12-20T22:37:01.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1550 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 03ea3515-8487-4760-80cf-a50af840be00 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
68902024-12-20T22:37:02.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3b4ed344-a4f7-4538-a924-46b66d5e9c11 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
68912024-12-20T22:37:02.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3b4ed344-a4f7-4538-a924-46b66d5e9c11 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
68922024-12-20T22:37:02.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3b4ed344-a4f7-4538-a924-46b66d5e9c11 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
68932024-12-20T22:37:03.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e898d37f-8d8b-4aa9-9426-20b355eb67f6 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
68942024-12-20T22:37:03.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e898d37f-8d8b-4aa9-9426-20b355eb67f6 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
68952024-12-20T22:37:03.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2002 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e898d37f-8d8b-4aa9-9426-20b355eb67f6 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
68962024-12-20T22:37:04.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b7891d8a-a669-4bb1-b914-d8052304aa7b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
68972024-12-20T22:37:04.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b7891d8a-a669-4bb1-b914-d8052304aa7b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
68982024-12-20T22:37:04.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b7891d8a-a669-4bb1-b914-d8052304aa7b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
68992024-12-20T22:37:05.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = b905c6a5-f992-44c7-a7a3-c9f009a9e0b6 roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
69002024-12-20T22:37:05.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = b905c6a5-f992-44c7-a7a3-c9f009a9e0b6 resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
69012024-12-20T22:37:05.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2613 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = b905c6a5-f992-44c7-a7a3-c9f009a9e0b6 response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
69022024-12-20T22:37:05.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 1c5491e1-09cb-45f1-be6d-fe4c1cfa3221 roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
69032024-12-20T22:37:05.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 1c5491e1-09cb-45f1-be6d-fe4c1cfa3221 resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
69042024-12-20T22:37:05.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 1c5491e1-09cb-45f1-be6d-fe4c1cfa3221 response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
69052024-12-20T22:37:05.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 958 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 5027ef01-69d1-4a72-86e4-6d0eb54907a8 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
69062024-12-20T22:37:05.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 445c629a-da5f-4168-83d1-d5275cb08f46 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69072024-12-20T22:37:05.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 445c629a-da5f-4168-83d1-d5275cb08f46 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69082024-12-20T22:37:05.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 445c629a-da5f-4168-83d1-d5275cb08f46 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69092024-12-20T22:37:06.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 064eba15-b434-4d86-9d06-bc194fa0c574 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69102024-12-20T22:37:06.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 064eba15-b434-4d86-9d06-bc194fa0c574 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69112024-12-20T22:37:06.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 064eba15-b434-4d86-9d06-bc194fa0c574 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69122024-12-20T22:37:07.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8c89ccf9-fdb2-45ab-999c-b714ae1542aa roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69132024-12-20T22:37:07.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8c89ccf9-fdb2-45ab-999c-b714ae1542aa resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69142024-12-20T22:37:07.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8c89ccf9-fdb2-45ab-999c-b714ae1542aa response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69152024-12-20T22:37:08.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = aaf7d522-a885-4fe3-9e4c-4960fd6a4acb roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69162024-12-20T22:37:08.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = aaf7d522-a885-4fe3-9e4c-4960fd6a4acb resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69172024-12-20T22:37:08.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = aaf7d522-a885-4fe3-9e4c-4960fd6a4acb response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69182024-12-20T22:37:09.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 589fddfb-d4ec-4360-ae7d-d81e5d7d710d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69192024-12-20T22:37:09.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 589fddfb-d4ec-4360-ae7d-d81e5d7d710d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69202024-12-20T22:37:09.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 589fddfb-d4ec-4360-ae7d-d81e5d7d710d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69212024-12-20T22:37:10.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
69222024-12-20T22:37:10.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69232024-12-20T22:37:10.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69242024-12-20T22:37:10.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
69252024-12-20T22:37:10.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69262024-12-20T22:37:10.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69272024-12-20T22:37:10.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69282024-12-20T22:37:10.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69292024-12-20T22:37:10.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69302024-12-20T22:37:10.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69312024-12-20T22:37:10.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69322024-12-20T22:37:10.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.931578ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69332024-12-20T22:37:10.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69342024-12-20T22:37:10.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69352024-12-20T22:37:10.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69362024-12-20T22:37:10.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69372024-12-20T22:37:10.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
69382024-12-20T22:37:10.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69392024-12-20T22:37:10.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69402024-12-20T22:37:10.591ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
69412024-12-20T22:37:10.591ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.598321ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
69422024-12-20T22:37:10.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0ef4a4c4-9874-4591-a453-834e52baf367 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69432024-12-20T22:37:10.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0ef4a4c4-9874-4591-a453-834e52baf367 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69442024-12-20T22:37:10.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0ef4a4c4-9874-4591-a453-834e52baf367 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69452024-12-20T22:37:11.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4291e8a9-5ebd-4fa6-a425-8b2c6db478b9 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69462024-12-20T22:37:11.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4291e8a9-5ebd-4fa6-a425-8b2c6db478b9 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69472024-12-20T22:37:11.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4291e8a9-5ebd-4fa6-a425-8b2c6db478b9 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69482024-12-20T22:37:12.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1bd7b2ce-adcc-469e-be3c-0f5776718329 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69492024-12-20T22:37:12.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1bd7b2ce-adcc-469e-be3c-0f5776718329 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69502024-12-20T22:37:12.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1bd7b2ce-adcc-469e-be3c-0f5776718329 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69512024-12-20T22:37:13.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = bbfe0c80-8e6c-46bd-8104-70d343d4b0e0 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69522024-12-20T22:37:13.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = bbfe0c80-8e6c-46bd-8104-70d343d4b0e0 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69532024-12-20T22:37:13.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = bbfe0c80-8e6c-46bd-8104-70d343d4b0e0 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69542024-12-20T22:37:15.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8a7ddcfb-c3f8-4fa0-9711-d3b9145cd1aa roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69552024-12-20T22:37:15.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8a7ddcfb-c3f8-4fa0-9711-d3b9145cd1aa resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69562024-12-20T22:37:15.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8a7ddcfb-c3f8-4fa0-9711-d3b9145cd1aa response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69572024-12-20T22:37:15.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 875 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 7c678fce-470e-4236-a530-c60fa39dcc93 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
69582024-12-20T22:37:16.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d8ac7264-378d-407d-994a-31c6d675b7ce roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69592024-12-20T22:37:16.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d8ac7264-378d-407d-994a-31c6d675b7ce resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69602024-12-20T22:37:16.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d8ac7264-378d-407d-994a-31c6d675b7ce response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69612024-12-20T22:37:17.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3fb4062a-0ba6-47d5-bb67-9f1c7893b1b7 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69622024-12-20T22:37:17.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3fb4062a-0ba6-47d5-bb67-9f1c7893b1b7 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69632024-12-20T22:37:17.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2514 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3fb4062a-0ba6-47d5-bb67-9f1c7893b1b7 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69642024-12-20T22:37:18.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3b74e290-09ca-4ec2-8006-eb365ea3a93a roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69652024-12-20T22:37:18.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3b74e290-09ca-4ec2-8006-eb365ea3a93a resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69662024-12-20T22:37:18.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3b74e290-09ca-4ec2-8006-eb365ea3a93a response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69672024-12-20T22:37:19.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f3ce7dd2-7738-4228-a682-42252897ba2c roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69682024-12-20T22:37:19.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f3ce7dd2-7738-4228-a682-42252897ba2c resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69692024-12-20T22:37:19.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1873 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f3ce7dd2-7738-4228-a682-42252897ba2c response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69702024-12-20T22:37:20.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 38b7e214-4c83-4268-bfdd-9184ebb3f9cc roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69712024-12-20T22:37:20.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 38b7e214-4c83-4268-bfdd-9184ebb3f9cc resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69722024-12-20T22:37:20.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2466 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 38b7e214-4c83-4268-bfdd-9184ebb3f9cc response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69732024-12-20T22:37:20.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
69742024-12-20T22:37:20.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69752024-12-20T22:37:20.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69762024-12-20T22:37:20.572ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
69772024-12-20T22:37:20.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69782024-12-20T22:37:20.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69792024-12-20T22:37:20.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69802024-12-20T22:37:20.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69812024-12-20T22:37:20.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69822024-12-20T22:37:20.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69832024-12-20T22:37:20.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69842024-12-20T22:37:20.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.224177ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69852024-12-20T22:37:20.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69862024-12-20T22:37:20.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69872024-12-20T22:37:20.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69882024-12-20T22:37:20.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69892024-12-20T22:37:20.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
69902024-12-20T22:37:20.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69912024-12-20T22:37:20.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69922024-12-20T22:37:20.593ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
69932024-12-20T22:37:20.594ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.890714ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
69942024-12-20T22:37:21.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 831817e3-9f21-4cc2-b6a2-c41fe1167012 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69952024-12-20T22:37:21.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 831817e3-9f21-4cc2-b6a2-c41fe1167012 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69962024-12-20T22:37:21.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 831817e3-9f21-4cc2-b6a2-c41fe1167012 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69972024-12-20T22:37:22.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2fb17cfb-78a5-4d3c-b64c-144022462797 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69982024-12-20T22:37:22.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2fb17cfb-78a5-4d3c-b64c-144022462797 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
69992024-12-20T22:37:22.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2fb17cfb-78a5-4d3c-b64c-144022462797 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70002024-12-20T22:37:23.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9b7efee1-43a8-41ad-8809-9157257a889b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70012024-12-20T22:37:23.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9b7efee1-43a8-41ad-8809-9157257a889b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70022024-12-20T22:37:23.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1850 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9b7efee1-43a8-41ad-8809-9157257a889b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70032024-12-20T22:37:24.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = eb1ac4f8-b5fa-41f2-af36-6c4edd0fb38d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70042024-12-20T22:37:24.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = eb1ac4f8-b5fa-41f2-af36-6c4edd0fb38d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70052024-12-20T22:37:24.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = eb1ac4f8-b5fa-41f2-af36-6c4edd0fb38d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70062024-12-20T22:37:25.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8c5b57c2-5227-4101-b15b-f453db2f9177 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70072024-12-20T22:37:25.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8c5b57c2-5227-4101-b15b-f453db2f9177 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70082024-12-20T22:37:25.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2456 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8c5b57c2-5227-4101-b15b-f453db2f9177 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70092024-12-20T22:37:25.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 526 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 952a73b0-0d2d-493f-a691-a76c5f91dfc9 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
70102024-12-20T22:37:26.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2eededd2-5435-4d35-aa06-e86515798efd roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70112024-12-20T22:37:26.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2eededd2-5435-4d35-aa06-e86515798efd resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70122024-12-20T22:37:26.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2eededd2-5435-4d35-aa06-e86515798efd response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70132024-12-20T22:37:27.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cf29ec51-141a-4366-b547-c4ddbe5d33df roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70142024-12-20T22:37:27.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cf29ec51-141a-4366-b547-c4ddbe5d33df resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70152024-12-20T22:37:27.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cf29ec51-141a-4366-b547-c4ddbe5d33df response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70162024-12-20T22:37:28.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9e18a7b3-d31d-4724-9445-b03acaac164e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70172024-12-20T22:37:28.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9e18a7b3-d31d-4724-9445-b03acaac164e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70182024-12-20T22:37:28.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9e18a7b3-d31d-4724-9445-b03acaac164e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70192024-12-20T22:37:29.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 76e9c8dd-8571-41d0-9600-fcd968e199f7 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70202024-12-20T22:37:29.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 76e9c8dd-8571-41d0-9600-fcd968e199f7 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70212024-12-20T22:37:29.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 76e9c8dd-8571-41d0-9600-fcd968e199f7 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70222024-12-20T22:37:30.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 69e0386c-ee98-44b2-a09d-5133ed574380 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70232024-12-20T22:37:30.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 69e0386c-ee98-44b2-a09d-5133ed574380 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70242024-12-20T22:37:30.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 69e0386c-ee98-44b2-a09d-5133ed574380 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
70252024-12-20T22:37:30.571ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
70262024-12-20T22:37:30.571ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70272024-12-20T22:37:30.571ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
70282024-12-20T22:37:30.571ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
70292024-12-20T22:37:30.571ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
70302024-12-20T22:37:30.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70312024-12-20T22:37:30.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
70322024-12-20T22:37:30.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
70332024-12-20T22:37:30.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70342024-12-20T22:37:30.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70352024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
70362024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
70372024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70382024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70392024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
70402024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70412024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
70422024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70432024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
70442024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70452024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
70462024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
70472024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
70482024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
70492024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
70502024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70512024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
70522024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
70532024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70542024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
70552024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70562024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
70572024-12-20T22:37:30.573ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
70582024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
70592024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70602024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70612024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
70622024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70632024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70642024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70652024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70662024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
70672024-12-20T22:37:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70682024-12-20T22:37:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70692024-12-20T22:37:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70702024-12-20T22:37:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70712024-12-20T22:37:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70722024-12-20T22:37:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
70732024-12-20T22:37:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70742024-12-20T22:37:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70752024-12-20T22:37:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70762024-12-20T22:37:30.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1398, tv_nsec: 186982692 } })
70772024-12-20T22:37:30.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1398, tv_nsec: 187126636 } })
70782024-12-20T22:37:30.574ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.778655ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
70792024-12-20T22:37:30.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
70802024-12-20T22:37:30.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
70812024-12-20T22:37:30.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70822024-12-20T22:37:30.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70832024-12-20T22:37:30.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70842024-12-20T22:37:30.575ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70852024-12-20T22:37:30.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70862024-12-20T22:37:30.576ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.177177ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
70872024-12-20T22:37:30.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70882024-12-20T22:37:30.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70892024-12-20T22:37:30.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70902024-12-20T22:37:30.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70912024-12-20T22:37:30.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70922024-12-20T22:37:30.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70932024-12-20T22:37:30.580ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70942024-12-20T22:37:30.580ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
70952024-12-20T22:37:30.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70962024-12-20T22:37:30.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70972024-12-20T22:37:30.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70982024-12-20T22:37:30.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70992024-12-20T22:37:30.582ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71002024-12-20T22:37:30.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71012024-12-20T22:37:30.583ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71022024-12-20T22:37:30.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71032024-12-20T22:37:30.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71042024-12-20T22:37:30.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
71052024-12-20T22:37:30.584ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71062024-12-20T22:37:30.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
71072024-12-20T22:37:30.584ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71082024-12-20T22:37:30.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71092024-12-20T22:37:30.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71102024-12-20T22:37:30.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71112024-12-20T22:37:30.587ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.583125ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71122024-12-20T22:37:30.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
71132024-12-20T22:37:30.588ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71142024-12-20T22:37:30.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71152024-12-20T22:37:30.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71162024-12-20T22:37:30.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71172024-12-20T22:37:30.590ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71182024-12-20T22:37:30.590ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71192024-12-20T22:37:30.590ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71202024-12-20T22:37:30.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71212024-12-20T22:37:30.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71222024-12-20T22:37:30.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71232024-12-20T22:37:30.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71242024-12-20T22:37:30.592ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1398, tv_nsec: 204779663 } })
71252024-12-20T22:37:30.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71262024-12-20T22:37:30.592ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
71272024-12-20T22:37:30.592ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71282024-12-20T22:37:30.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71292024-12-20T22:37:30.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71302024-12-20T22:37:30.593ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71312024-12-20T22:37:30.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71322024-12-20T22:37:30.594ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71332024-12-20T22:37:30.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
71342024-12-20T22:37:30.595ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71352024-12-20T22:37:30.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71362024-12-20T22:37:30.595ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
71372024-12-20T22:37:30.595ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 22.273595ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
71382024-12-20T22:37:30.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71392024-12-20T22:37:30.596ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71402024-12-20T22:37:30.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71412024-12-20T22:37:30.612ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
71422024-12-20T22:37:30.612ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 40.623062ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
71432024-12-20T22:37:30.618ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71442024-12-20T22:37:30.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71452024-12-20T22:37:30.620ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 46.908454ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71462024-12-20T22:37:30.623ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71472024-12-20T22:37:30.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71482024-12-20T22:37:30.624ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71492024-12-20T22:37:30.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71502024-12-20T22:37:30.630ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71512024-12-20T22:37:30.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
71522024-12-20T22:37:30.632ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71532024-12-20T22:37:30.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71542024-12-20T22:37:30.636ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 62.127334ms iteration = 24 status = 0
71552024-12-20T22:37:30.640ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71562024-12-20T22:37:30.640ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
71572024-12-20T22:37:30.640ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71582024-12-20T22:37:30.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71592024-12-20T22:37:30.643ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71602024-12-20T22:37:30.643ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
71612024-12-20T22:37:30.643ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 69.654333ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
71622024-12-20T22:37:30.645ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 71.866653ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
71632024-12-20T22:37:30.646ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71642024-12-20T22:37:30.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71652024-12-20T22:37:30.652ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 78.449255ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71662024-12-20T22:37:30.680ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
71672024-12-20T22:37:30.680ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71682024-12-20T22:37:30.681ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1824be3-133d-437a-a476-49601652253c", "content-length": "26", "date": "Fri, 20 Dec 2024 22:37:30 GMT"} })
71692024-12-20T22:37:30.681ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71702024-12-20T22:37:30.682ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71712024-12-20T22:37:30.690ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 117.080211ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
71722024-12-20T22:37:30.702ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71732024-12-20T22:37:30.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71742024-12-20T22:37:30.704ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71752024-12-20T22:37:30.706ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71762024-12-20T22:37:30.706ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71772024-12-20T22:37:30.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71782024-12-20T22:37:30.707ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71792024-12-20T22:37:30.709ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
71802024-12-20T22:37:30.709ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71812024-12-20T22:37:30.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71822024-12-20T22:37:30.719ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
71832024-12-20T22:37:30.719ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71842024-12-20T22:37:30.719ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b6e574a-08e8-46e3-86b7-ee75988c9a3f", "content-length": "372", "date": "Fri, 20 Dec 2024 22:37:30 GMT"} })
71852024-12-20T22:37:30.719ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71862024-12-20T22:37:30.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71872024-12-20T22:37:30.733ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
71882024-12-20T22:37:30.733ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
71892024-12-20T22:37:30.733ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0ce8ed27-e07e-4c81-8501-a32e7b2a70e2", "date": "Fri, 20 Dec 2024 22:37:30 GMT"} })
71902024-12-20T22:37:30.733ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71912024-12-20T22:37:30.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71922024-12-20T22:37:30.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71932024-12-20T22:37:30.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71942024-12-20T22:37:30.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71952024-12-20T22:37:30.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71962024-12-20T22:37:30.740ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
71972024-12-20T22:37:30.740ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
71982024-12-20T22:37:30.741ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "22b67dc1-adb4-4418-90c1-d4459c77fc73", "date": "Fri, 20 Dec 2024 22:37:30 GMT"} })
71992024-12-20T22:37:30.743ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 169.924359ms iteration = 24 status = {}
72002024-12-20T22:37:30.748ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
72012024-12-20T22:37:30.748ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72022024-12-20T22:37:30.748ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 174.791864ms iteration = 27 status = {"physical_disks_added":0}
72032024-12-20T22:37:30.748ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f821943-e69a-427c-b78c-f32d530714a8", "content-length": "26", "date": "Fri, 20 Dec 2024 22:37:30 GMT"} })
72042024-12-20T22:37:30.748ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72052024-12-20T22:37:30.751ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72062024-12-20T22:37:30.797ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 zone_address = fd00:1122:3344:101::2
72072024-12-20T22:37:30.797ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72082024-12-20T22:37:30.797ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff15fd8c-0374-4bb3-9297-edda38828ba6", "content-length": "26", "date": "Fri, 20 Dec 2024 22:37:30 GMT"} })
72092024-12-20T22:37:30.797ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72102024-12-20T22:37:30.799ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
72112024-12-20T22:37:30.829ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
72122024-12-20T22:37:30.829ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4750cf3d-31ca-49b6-bb39-38d5256ecb70", "content-length": "691", "date": "Fri, 20 Dec 2024 22:37:30 GMT"} })
72132024-12-20T22:37:30.829ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
72142024-12-20T22:37:30.829ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
72152024-12-20T22:37:30.829ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
72162024-12-20T22:37:30.830ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 256.771556ms iteration = 24 status = {}
72172024-12-20T22:37:30.844ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 273.093116ms iteration = 24 status = {}
72182024-12-20T22:37:30.884ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
72192024-12-20T22:37:30.884ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c13dbdd6-1ca9-4408-aeab-b6f4941e38f0", "content-length": "1", "date": "Fri, 20 Dec 2024 22:37:30 GMT"} })
72202024-12-20T22:37:30.886ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72212024-12-20T22:37:30.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72222024-12-20T22:37:30.888ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 316.955156ms iteration = 24 status = null
72232024-12-20T22:37:30.944ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72242024-12-20T22:37:30.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72252024-12-20T22:37:30.946ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9fedf0d4-8a86-4506-bf93-224faabd5e37, rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b26f0563-25fb-4d7c-8480-dd368ac01105) } rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
72262024-12-20T22:37:30.946ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72272024-12-20T22:37:30.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72282024-12-20T22:37:30.954ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
72292024-12-20T22:37:30.954ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "816c7759-911b-44df-a45d-25138ed3a350", "content-length": "134", "date": "Fri, 20 Dec 2024 22:37:30 GMT"} })
72302024-12-20T22:37:30.954ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
72312024-12-20T22:37:30.954ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b26f0563-25fb-4d7c-8480-dd368ac01105
72322024-12-20T22:37:30.955ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
72332024-12-20T22:37:30.955ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
72342024-12-20T22:37:30.955ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72352024-12-20T22:37:30.955ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72362024-12-20T22:37:30.955ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72372024-12-20T22:37:30.955ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72382024-12-20T22:37:30.955ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72392024-12-20T22:37:30.955ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72402024-12-20T22:37:30.955ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
72412024-12-20T22:37:30.955ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72422024-12-20T22:37:30.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72432024-12-20T22:37:30.957ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
72442024-12-20T22:37:30.957ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6535293c-16dc-4320-b679-d5777a224d8f", "content-length": "2", "date": "Fri, 20 Dec 2024 22:37:30 GMT"} })
72452024-12-20T22:37:30.958ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
72462024-12-20T22:37:30.958ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5f230e4-a900-4b05-b56f-eefba5b3ee19", "content-length": "52", "date": "Fri, 20 Dec 2024 22:37:30 GMT"} })
72472024-12-20T22:37:30.958ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
72482024-12-20T22:37:30.958ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
72492024-12-20T22:37:30.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 3111701d-0cad-499b-8d15-9151b43d90ff roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
72502024-12-20T22:37:30.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 3111701d-0cad-499b-8d15-9151b43d90ff resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
72512024-12-20T22:37:30.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2959 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 3111701d-0cad-499b-8d15-9151b43d90ff response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
72522024-12-20T22:37:31.049ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b464436e-fe23-4c6f-909f-1990d9c05fc8", "date": "Fri, 20 Dec 2024 22:37:30 GMT"} })
72532024-12-20T22:37:31.049ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch = Switch0
72542024-12-20T22:37:31.049ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
72552024-12-20T22:37:31.049ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2df83ada-c5f3-406a-a9db-758ff15e52f9", "content-length": "682", "date": "Fri, 20 Dec 2024 22:37:30 GMT"} })
72562024-12-20T22:37:31.049ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72572024-12-20T22:37:31.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72582024-12-20T22:37:31.053ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72592024-12-20T22:37:31.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72602024-12-20T22:37:31.057ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72612024-12-20T22:37:31.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72622024-12-20T22:37:31.059ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72632024-12-20T22:37:31.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72642024-12-20T22:37:31.066ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 492.510851ms iteration = 24 status = {}
72652024-12-20T22:37:31.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 88e294c1-ceed-4f86-b585-f8340f6e917d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72662024-12-20T22:37:31.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 88e294c1-ceed-4f86-b585-f8340f6e917d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72672024-12-20T22:37:31.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 88e294c1-ceed-4f86-b585-f8340f6e917d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72682024-12-20T22:37:32.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2ae7b56c-6762-4461-8f1d-c6b5f90d2690 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72692024-12-20T22:37:32.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2ae7b56c-6762-4461-8f1d-c6b5f90d2690 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72702024-12-20T22:37:32.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2ae7b56c-6762-4461-8f1d-c6b5f90d2690 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72712024-12-20T22:37:33.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8ed4bb46-9c4f-4462-9fb9-acd53765fc39 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72722024-12-20T22:37:33.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8ed4bb46-9c4f-4462-9fb9-acd53765fc39 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72732024-12-20T22:37:33.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8ed4bb46-9c4f-4462-9fb9-acd53765fc39 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72742024-12-20T22:37:34.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a643aeb9-bc53-4c77-b1cf-5ecac10fc359 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72752024-12-20T22:37:34.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a643aeb9-bc53-4c77-b1cf-5ecac10fc359 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72762024-12-20T22:37:34.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a643aeb9-bc53-4c77-b1cf-5ecac10fc359 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72772024-12-20T22:37:35.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 648b05ee-53c3-41e2-8640-0ec73c546354 roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
72782024-12-20T22:37:35.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 648b05ee-53c3-41e2-8640-0ec73c546354 resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
72792024-12-20T22:37:35.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 648b05ee-53c3-41e2-8640-0ec73c546354 response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
72802024-12-20T22:37:35.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 353d1377-add3-4cf3-83e9-90414176babe roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
72812024-12-20T22:37:35.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 353d1377-add3-4cf3-83e9-90414176babe resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
72822024-12-20T22:37:35.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 353d1377-add3-4cf3-83e9-90414176babe response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
72832024-12-20T22:37:35.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 549 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 46616bbf-2966-49c6-82b8-d8cc5ef8772e response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
72842024-12-20T22:37:35.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 08df54a7-a94c-4626-aa54-49ea0a88f4fb roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72852024-12-20T22:37:35.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 08df54a7-a94c-4626-aa54-49ea0a88f4fb resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72862024-12-20T22:37:35.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 08df54a7-a94c-4626-aa54-49ea0a88f4fb response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72872024-12-20T22:37:36.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7112be59-25a3-4961-94b9-5f3912474dc7 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72882024-12-20T22:37:36.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7112be59-25a3-4961-94b9-5f3912474dc7 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72892024-12-20T22:37:36.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1844 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7112be59-25a3-4961-94b9-5f3912474dc7 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72902024-12-20T22:37:37.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5ffe18a0-ed45-4008-81d1-c610d38badcf roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72912024-12-20T22:37:37.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5ffe18a0-ed45-4008-81d1-c610d38badcf resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72922024-12-20T22:37:37.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5ffe18a0-ed45-4008-81d1-c610d38badcf response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72932024-12-20T22:37:38.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c0622fcc-bd5e-4fa3-8643-2da5fdc8e64b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72942024-12-20T22:37:38.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c0622fcc-bd5e-4fa3-8643-2da5fdc8e64b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72952024-12-20T22:37:38.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c0622fcc-bd5e-4fa3-8643-2da5fdc8e64b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72962024-12-20T22:37:39.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 571babfe-5228-49b1-b5b8-bc751fb2cdf6 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72972024-12-20T22:37:39.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 571babfe-5228-49b1-b5b8-bc751fb2cdf6 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72982024-12-20T22:37:39.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 571babfe-5228-49b1-b5b8-bc751fb2cdf6 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
72992024-12-20T22:37:40.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d344d26b-e99b-45d7-8b64-81802212230a roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73002024-12-20T22:37:40.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d344d26b-e99b-45d7-8b64-81802212230a resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73012024-12-20T22:37:40.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d344d26b-e99b-45d7-8b64-81802212230a response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73022024-12-20T22:37:40.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
73032024-12-20T22:37:40.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73042024-12-20T22:37:40.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73052024-12-20T22:37:40.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
73062024-12-20T22:37:40.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73072024-12-20T22:37:40.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73082024-12-20T22:37:40.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73092024-12-20T22:37:40.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73102024-12-20T22:37:40.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73112024-12-20T22:37:40.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.214046ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73122024-12-20T22:37:40.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73132024-12-20T22:37:40.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73142024-12-20T22:37:40.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73152024-12-20T22:37:40.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73162024-12-20T22:37:40.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73172024-12-20T22:37:40.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73182024-12-20T22:37:40.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
73192024-12-20T22:37:40.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73202024-12-20T22:37:40.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73212024-12-20T22:37:40.594ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
73222024-12-20T22:37:40.594ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.574786ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
73232024-12-20T22:37:41.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b156af5c-9158-4f43-a6f3-bb8ee66b9962 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73242024-12-20T22:37:41.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b156af5c-9158-4f43-a6f3-bb8ee66b9962 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73252024-12-20T22:37:41.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b156af5c-9158-4f43-a6f3-bb8ee66b9962 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73262024-12-20T22:37:42.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cc24b590-4fba-481e-874b-524f957d4cc7 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73272024-12-20T22:37:42.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cc24b590-4fba-481e-874b-524f957d4cc7 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73282024-12-20T22:37:42.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cc24b590-4fba-481e-874b-524f957d4cc7 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73292024-12-20T22:37:43.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3b3aca3c-b1e6-4ac1-8dac-b5450adf3ee8 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73302024-12-20T22:37:43.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3b3aca3c-b1e6-4ac1-8dac-b5450adf3ee8 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73312024-12-20T22:37:43.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3b3aca3c-b1e6-4ac1-8dac-b5450adf3ee8 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73322024-12-20T22:37:44.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6f07e8d1-c210-451a-b172-5301943577f4 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73332024-12-20T22:37:44.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6f07e8d1-c210-451a-b172-5301943577f4 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73342024-12-20T22:37:44.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6f07e8d1-c210-451a-b172-5301943577f4 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73352024-12-20T22:37:45.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 754 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 7724b29a-8c62-4cfd-90a1-58649259fc21 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
73362024-12-20T22:37:45.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2129696c-7a1f-4ffa-aada-fc0df8277e5e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73372024-12-20T22:37:45.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2129696c-7a1f-4ffa-aada-fc0df8277e5e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73382024-12-20T22:37:45.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1862 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2129696c-7a1f-4ffa-aada-fc0df8277e5e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73392024-12-20T22:37:46.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 66997f24-a28b-4524-b125-005164ebf2e1 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73402024-12-20T22:37:46.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 66997f24-a28b-4524-b125-005164ebf2e1 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73412024-12-20T22:37:46.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 66997f24-a28b-4524-b125-005164ebf2e1 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73422024-12-20T22:37:47.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1dd5a581-d362-4cb1-a285-27ba8f28e5ee roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73432024-12-20T22:37:47.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1dd5a581-d362-4cb1-a285-27ba8f28e5ee resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73442024-12-20T22:37:47.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2694 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1dd5a581-d362-4cb1-a285-27ba8f28e5ee response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73452024-12-20T22:37:48.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 04f155fb-e454-449a-9f2d-60a4db87c2e7 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73462024-12-20T22:37:48.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 04f155fb-e454-449a-9f2d-60a4db87c2e7 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73472024-12-20T22:37:48.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2633 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 04f155fb-e454-449a-9f2d-60a4db87c2e7 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73482024-12-20T22:37:49.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f597fe09-4071-4c8d-963a-f7d67d10f0da roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73492024-12-20T22:37:49.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f597fe09-4071-4c8d-963a-f7d67d10f0da resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73502024-12-20T22:37:49.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f597fe09-4071-4c8d-963a-f7d67d10f0da response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73512024-12-20T22:37:50.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
73522024-12-20T22:37:50.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73532024-12-20T22:37:50.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73542024-12-20T22:37:50.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
73552024-12-20T22:37:50.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73562024-12-20T22:37:50.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73572024-12-20T22:37:50.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73582024-12-20T22:37:50.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73592024-12-20T22:37:50.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73602024-12-20T22:37:50.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73612024-12-20T22:37:50.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73622024-12-20T22:37:50.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73632024-12-20T22:37:50.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.248587ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73642024-12-20T22:37:50.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73652024-12-20T22:37:50.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73662024-12-20T22:37:50.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73672024-12-20T22:37:50.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
73682024-12-20T22:37:50.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73692024-12-20T22:37:50.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73702024-12-20T22:37:50.593ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
73712024-12-20T22:37:50.593ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.095502ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
73722024-12-20T22:37:50.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ebd3d79c-b40a-4f0a-9b67-b1611d2aa318 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73732024-12-20T22:37:50.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ebd3d79c-b40a-4f0a-9b67-b1611d2aa318 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73742024-12-20T22:37:50.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ebd3d79c-b40a-4f0a-9b67-b1611d2aa318 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73752024-12-20T22:37:51.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1db38335-a258-4682-95a3-8cd2e8ba7aab roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73762024-12-20T22:37:51.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1db38335-a258-4682-95a3-8cd2e8ba7aab resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73772024-12-20T22:37:51.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2644 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1db38335-a258-4682-95a3-8cd2e8ba7aab response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73782024-12-20T22:37:52.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = bd34eef1-82c3-412e-9cf2-0758f9c6ac4b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73792024-12-20T22:37:52.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = bd34eef1-82c3-412e-9cf2-0758f9c6ac4b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73802024-12-20T22:37:52.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = bd34eef1-82c3-412e-9cf2-0758f9c6ac4b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73812024-12-20T22:37:53.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 375218f1-a495-4fc9-be08-416c99748710 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73822024-12-20T22:37:53.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 375218f1-a495-4fc9-be08-416c99748710 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73832024-12-20T22:37:53.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 375218f1-a495-4fc9-be08-416c99748710 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73842024-12-20T22:37:54.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1d67d663-141d-4f59-89b3-eb81b3254baf roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73852024-12-20T22:37:54.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1d67d663-141d-4f59-89b3-eb81b3254baf resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73862024-12-20T22:37:54.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2464 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1d67d663-141d-4f59-89b3-eb81b3254baf response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73872024-12-20T22:37:55.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 633 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 43b0cd7a-2ad2-46b8-87c9-e63f6b69905d response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
73882024-12-20T22:37:55.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cb019e69-0766-48c3-8032-7844fe4d1fce roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73892024-12-20T22:37:55.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cb019e69-0766-48c3-8032-7844fe4d1fce resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73902024-12-20T22:37:55.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cb019e69-0766-48c3-8032-7844fe4d1fce response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73912024-12-20T22:37:56.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6b981cc9-d02b-4fa0-8d1f-431461f36002 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73922024-12-20T22:37:56.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6b981cc9-d02b-4fa0-8d1f-431461f36002 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73932024-12-20T22:37:56.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6b981cc9-d02b-4fa0-8d1f-431461f36002 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73942024-12-20T22:37:57.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e4440c7e-a012-4c1d-9e23-c6c768ba2a5f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73952024-12-20T22:37:57.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e4440c7e-a012-4c1d-9e23-c6c768ba2a5f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73962024-12-20T22:37:57.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e4440c7e-a012-4c1d-9e23-c6c768ba2a5f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73972024-12-20T22:37:58.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4b2190f8-11f2-4091-9151-a069fc480d96 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73982024-12-20T22:37:58.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4b2190f8-11f2-4091-9151-a069fc480d96 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
73992024-12-20T22:37:58.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4b2190f8-11f2-4091-9151-a069fc480d96 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
74002024-12-20T22:37:59.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4270ac3d-2256-4d2f-92f1-05b3a2d20810 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
74012024-12-20T22:37:59.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4270ac3d-2256-4d2f-92f1-05b3a2d20810 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
74022024-12-20T22:37:59.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1972 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4270ac3d-2256-4d2f-92f1-05b3a2d20810 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
74032024-12-20T22:38:00.571ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
74042024-12-20T22:38:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
74052024-12-20T22:38:00.571ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74062024-12-20T22:38:00.571ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
74072024-12-20T22:38:00.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74082024-12-20T22:38:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
74092024-12-20T22:38:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
74102024-12-20T22:38:00.571ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
74112024-12-20T22:38:00.571ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
74122024-12-20T22:38:00.571ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74132024-12-20T22:38:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
74142024-12-20T22:38:00.571ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
74152024-12-20T22:38:00.571ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:28:00.571643410 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
74162024-12-20T22:38:00.571ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
74172024-12-20T22:38:00.571ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
74182024-12-20T22:38:00.571ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
74192024-12-20T22:38:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
74202024-12-20T22:38:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
74212024-12-20T22:38:00.571ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
74222024-12-20T22:38:00.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74232024-12-20T22:38:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74242024-12-20T22:38:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74252024-12-20T22:38:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
74262024-12-20T22:38:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
74272024-12-20T22:38:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74282024-12-20T22:38:00.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
74292024-12-20T22:38:00.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
74302024-12-20T22:38:00.572ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e
74312024-12-20T22:38:00.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74322024-12-20T22:38:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.88\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e"}
74332024-12-20T22:38:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74342024-12-20T22:38:00.572ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b172144-6fe3-403a-b88e-6be93db6788c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e1e925bb-4266-49d2-b532-0f79860badbb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9d7e78a-d944-4f23-9be0-86e0f1334a43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9d7e78a-d944-4f23-9be0-86e0f1334a43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1428, tv_nsec: 184714150 } })
74352024-12-20T22:38:00.572ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bcf7579-f08c-458a-b8fa-486beafab77e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c65750e1-e505-4d05-b242-145c69974016.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c65750e1-e505-4d05-b242-145c69974016.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1428, tv_nsec: 184731390 } })
74362024-12-20T22:38:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74372024-12-20T22:38:00.572ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
74382024-12-20T22:38:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.118351ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
74392024-12-20T22:38:00.572ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74402024-12-20T22:38:00.572ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
74412024-12-20T22:38:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.276805ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
74422024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74432024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
74442024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74452024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
74462024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
74472024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74482024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
74492024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
74502024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
74512024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
74522024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
74532024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74542024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
74552024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
74562024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
74572024-12-20T22:38:00.573ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
74582024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
74592024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74602024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
74612024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
74622024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
74632024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
74642024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
74652024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74662024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
74672024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
74682024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74692024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
74702024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74712024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
74722024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74732024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
74742024-12-20T22:38:00.573ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
74752024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74762024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
74772024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
74782024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
74792024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74802024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
74812024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74822024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74832024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
74842024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
74852024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
74862024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74872024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74882024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
74892024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
74902024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
74912024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74922024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
74932024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74942024-12-20T22:38:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74952024-12-20T22:38:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74962024-12-20T22:38:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74972024-12-20T22:38:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
74982024-12-20T22:38:00.574ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
74992024-12-20T22:38:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75002024-12-20T22:38:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75012024-12-20T22:38:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75022024-12-20T22:38:00.574ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75032024-12-20T22:38:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75042024-12-20T22:38:00.574ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75052024-12-20T22:38:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75062024-12-20T22:38:00.574ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75072024-12-20T22:38:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75082024-12-20T22:38:00.574ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75092024-12-20T22:38:00.575ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:28:00.571643410 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
75102024-12-20T22:38:00.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75112024-12-20T22:38:00.575ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.040011ms iteration = 13 status = {"expiration":"2024-12-20T22:28:00.571643410Z","pruned":[]}
75122024-12-20T22:38:00.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75132024-12-20T22:38:00.576ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.480823ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
75142024-12-20T22:38:00.576ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1428, tv_nsec: 188649498 } })
75152024-12-20T22:38:00.576ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
75162024-12-20T22:38:00.576ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1428, tv_nsec: 189199683 } })
75172024-12-20T22:38:00.576ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
75182024-12-20T22:38:00.576ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75192024-12-20T22:38:00.576ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
75202024-12-20T22:38:00.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75212024-12-20T22:38:00.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75222024-12-20T22:38:00.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75232024-12-20T22:38:00.579ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75242024-12-20T22:38:00.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75252024-12-20T22:38:00.580ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.073365ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
75262024-12-20T22:38:00.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75272024-12-20T22:38:00.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75282024-12-20T22:38:00.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75292024-12-20T22:38:00.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
75302024-12-20T22:38:00.584ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.85523ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
75312024-12-20T22:38:00.585ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75322024-12-20T22:38:00.585ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
75332024-12-20T22:38:00.585ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75342024-12-20T22:38:00.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75352024-12-20T22:38:00.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
75362024-12-20T22:38:00.586ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75372024-12-20T22:38:00.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
75382024-12-20T22:38:00.587ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75392024-12-20T22:38:00.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
75402024-12-20T22:38:00.588ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
75412024-12-20T22:38:00.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
75422024-12-20T22:38:00.590ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 16.681041ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
75432024-12-20T22:38:00.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
75442024-12-20T22:38:00.590ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75452024-12-20T22:38:00.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75462024-12-20T22:38:00.591ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75472024-12-20T22:38:00.591ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75482024-12-20T22:38:00.594ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75492024-12-20T22:38:00.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75502024-12-20T22:38:00.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75512024-12-20T22:38:00.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75522024-12-20T22:38:00.595ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75532024-12-20T22:38:00.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75542024-12-20T22:38:00.596ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75552024-12-20T22:38:00.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75562024-12-20T22:38:00.597ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75572024-12-20T22:38:00.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
75582024-12-20T22:38:00.599ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75592024-12-20T22:38:00.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75602024-12-20T22:38:00.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
75612024-12-20T22:38:00.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75622024-12-20T22:38:00.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75632024-12-20T22:38:00.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
75642024-12-20T22:38:00.601ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75652024-12-20T22:38:00.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75662024-12-20T22:38:00.601ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75672024-12-20T22:38:00.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
75682024-12-20T22:38:00.603ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75692024-12-20T22:38:00.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75702024-12-20T22:38:00.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75712024-12-20T22:38:00.612ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75722024-12-20T22:38:00.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
75732024-12-20T22:38:00.614ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75742024-12-20T22:38:00.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75752024-12-20T22:38:00.614ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75762024-12-20T22:38:00.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75772024-12-20T22:38:00.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 42.225915ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75782024-12-20T22:38:00.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
75792024-12-20T22:38:00.619ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75802024-12-20T22:38:00.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75812024-12-20T22:38:00.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75822024-12-20T22:38:00.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75832024-12-20T22:38:00.620ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
75842024-12-20T22:38:00.620ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
75852024-12-20T22:38:00.620ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
75862024-12-20T22:38:00.620ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75872024-12-20T22:38:00.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75882024-12-20T22:38:00.622ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75892024-12-20T22:38:00.624ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75902024-12-20T22:38:00.624ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75912024-12-20T22:38:00.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75922024-12-20T22:38:00.629ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75932024-12-20T22:38:00.629ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
75942024-12-20T22:38:00.629ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 56.308104ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
75952024-12-20T22:38:00.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75962024-12-20T22:38:00.630ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75972024-12-20T22:38:00.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75982024-12-20T22:38:00.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75992024-12-20T22:38:00.632ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76002024-12-20T22:38:00.634ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1428, tv_nsec: 247159783 } })
76012024-12-20T22:38:00.635ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
76022024-12-20T22:38:00.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
76032024-12-20T22:38:00.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76042024-12-20T22:38:00.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76052024-12-20T22:38:00.636ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76062024-12-20T22:38:00.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76072024-12-20T22:38:00.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76082024-12-20T22:38:00.641ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76092024-12-20T22:38:00.643ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76102024-12-20T22:38:00.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76112024-12-20T22:38:00.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76122024-12-20T22:38:00.644ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76132024-12-20T22:38:00.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76142024-12-20T22:38:00.651ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76152024-12-20T22:38:00.653ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
76162024-12-20T22:38:00.653ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
76172024-12-20T22:38:00.653ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 80.156652ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
76182024-12-20T22:38:00.655ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
76192024-12-20T22:38:00.655ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.884017ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
76202024-12-20T22:38:00.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
76212024-12-20T22:38:00.655ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76222024-12-20T22:38:00.655ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76232024-12-20T22:38:00.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76242024-12-20T22:38:00.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76252024-12-20T22:38:00.657ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76262024-12-20T22:38:00.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76272024-12-20T22:38:00.660ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
76282024-12-20T22:38:00.660ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
76292024-12-20T22:38:00.660ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
76302024-12-20T22:38:00.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76312024-12-20T22:38:00.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76322024-12-20T22:38:00.661ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76332024-12-20T22:38:00.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76342024-12-20T22:38:00.662ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76352024-12-20T22:38:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
76362024-12-20T22:38:00.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76372024-12-20T22:38:00.666ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76382024-12-20T22:38:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76392024-12-20T22:38:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76402024-12-20T22:38:00.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 94.6081ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
76412024-12-20T22:38:00.668ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
76422024-12-20T22:38:00.668ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
76432024-12-20T22:38:00.668ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76442024-12-20T22:38:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76452024-12-20T22:38:00.669ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76462024-12-20T22:38:00.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76472024-12-20T22:38:00.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76482024-12-20T22:38:00.671ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76492024-12-20T22:38:00.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
76502024-12-20T22:38:00.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76512024-12-20T22:38:00.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76522024-12-20T22:38:00.674ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76532024-12-20T22:38:00.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76542024-12-20T22:38:00.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
76552024-12-20T22:38:00.676ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76562024-12-20T22:38:00.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76572024-12-20T22:38:00.677ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
76582024-12-20T22:38:00.677ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
76592024-12-20T22:38:00.677ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:26:39.700273 UTC dns_group = internal generation = 1
76602024-12-20T22:38:00.677ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 105.587534ms iteration = 13 status = {"generation":1}
76612024-12-20T22:38:00.678ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 104.879324ms iteration = 25 status = 0
76622024-12-20T22:38:00.681ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 108.304829ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
76632024-12-20T22:38:00.682ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
76642024-12-20T22:38:00.682ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 0 version = 2
76652024-12-20T22:38:00.682ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76662024-12-20T22:38:00.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76672024-12-20T22:38:00.684ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76682024-12-20T22:38:00.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76692024-12-20T22:38:00.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76702024-12-20T22:38:00.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76712024-12-20T22:38:00.688ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 1 version = 2
76722024-12-20T22:38:00.688ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
76732024-12-20T22:38:00.688ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:26:40.428768 UTC dns_group = external generation = 2
76742024-12-20T22:38:00.688ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 117.081451ms iteration = 13 status = {"generation":2}
76752024-12-20T22:38:00.688ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76762024-12-20T22:38:00.691ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
76772024-12-20T22:38:00.691ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76782024-12-20T22:38:00.691ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76792024-12-20T22:38:00.691ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e747cb54-406a-4e31-86c4-088e048649ad", "content-length": "26", "date": "Fri, 20 Dec 2024 22:38:00 GMT"} })
76802024-12-20T22:38:00.691ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76812024-12-20T22:38:00.692ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
76822024-12-20T22:38:00.692ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76832024-12-20T22:38:00.693ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "224b0e07-261d-4161-a83a-69558de31b42", "content-length": "26", "date": "Fri, 20 Dec 2024 22:38:00 GMT"} })
76842024-12-20T22:38:00.693ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76852024-12-20T22:38:00.693ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76862024-12-20T22:38:00.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
76872024-12-20T22:38:00.693ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76882024-12-20T22:38:00.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76892024-12-20T22:38:00.694ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
76902024-12-20T22:38:00.694ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76912024-12-20T22:38:00.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76922024-12-20T22:38:00.695ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76932024-12-20T22:38:00.695ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
76942024-12-20T22:38:00.695ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
76952024-12-20T22:38:00.695ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 122.270755ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
76962024-12-20T22:38:00.696ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76972024-12-20T22:38:00.696ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
76982024-12-20T22:38:00.696ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76992024-12-20T22:38:00.696ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 122.693035ms iteration = 6 status = {"nsuccess":5}
77002024-12-20T22:38:00.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77012024-12-20T22:38:00.703ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
77022024-12-20T22:38:00.706ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77032024-12-20T22:38:00.707ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
77042024-12-20T22:38:00.708ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77052024-12-20T22:38:00.708ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77062024-12-20T22:38:00.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77072024-12-20T22:38:00.713ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77082024-12-20T22:38:00.716ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77092024-12-20T22:38:00.716ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77102024-12-20T22:38:00.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77112024-12-20T22:38:00.721ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 148.110328ms iteration = 28 status = {"physical_disks_added":0}
77122024-12-20T22:38:00.721ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 148.517309ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
77132024-12-20T22:38:00.747ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77142024-12-20T22:38:00.747ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
77152024-12-20T22:38:00.747ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 174.102884ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
77162024-12-20T22:38:00.749ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77172024-12-20T22:38:00.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77182024-12-20T22:38:00.750ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77192024-12-20T22:38:00.752ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
77202024-12-20T22:38:00.752ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77212024-12-20T22:38:00.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77222024-12-20T22:38:00.771ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 zone_address = fd00:1122:3344:101::2
77232024-12-20T22:38:00.771ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77242024-12-20T22:38:00.771ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "35ce5eaa-e70c-40a0-afee-47ee975faad9", "content-length": "26", "date": "Fri, 20 Dec 2024 22:38:00 GMT"} })
77252024-12-20T22:38:00.771ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77262024-12-20T22:38:00.773ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
77272024-12-20T22:38:00.776ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
77282024-12-20T22:38:00.776ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 203.244099ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
77292024-12-20T22:38:00.809ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:25:57.040586Z, time_modified: 2024-12-20T22:25:57.040586Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }) }
77302024-12-20T22:38:00.809ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 238.170563ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]}},"default_endpoint":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
77312024-12-20T22:38:00.841ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
77322024-12-20T22:38:00.841ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ce668f0-1928-4410-940f-87add4fb4dfb", "content-length": "1", "date": "Fri, 20 Dec 2024 22:38:00 GMT"} })
77332024-12-20T22:38:00.843ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77342024-12-20T22:38:00.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77352024-12-20T22:38:00.894ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
77362024-12-20T22:38:00.894ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "996dfd5b-b46f-43a6-b048-5a9776a578a1", "date": "Fri, 20 Dec 2024 22:38:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
77372024-12-20T22:38:00.894ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
77382024-12-20T22:38:00.895ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "24e12e7e-b861-428c-88b0-bad79c6713c8", "date": "Fri, 20 Dec 2024 22:38:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
77392024-12-20T22:38:00.895ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
77402024-12-20T22:38:00.897ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
77412024-12-20T22:38:00.897ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 326.217623ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
77422024-12-20T22:38:00.901ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
77432024-12-20T22:38:00.925ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 353.485255ms iteration = 25 status = {}
77442024-12-20T22:38:00.952ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
77452024-12-20T22:38:00.952ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "97cf2b6f-8c9c-4014-a903-7fd65a69913d", "content-length": "691", "date": "Fri, 20 Dec 2024 22:38:00 GMT"} })
77462024-12-20T22:38:00.952ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
77472024-12-20T22:38:00.952ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
77482024-12-20T22:38:00.952ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
77492024-12-20T22:38:00.954ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 382.556767ms iteration = 25 status = null
77502024-12-20T22:38:00.955ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 381.472748ms iteration = 25 status = {}
77512024-12-20T22:38:00.965ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
77522024-12-20T22:38:00.965ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77532024-12-20T22:38:00.966ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d09d1aaa-20bd-4808-a662-5b3b4e3d7100", "content-length": "372", "date": "Fri, 20 Dec 2024 22:38:00 GMT"} })
77542024-12-20T22:38:00.966ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77552024-12-20T22:38:00.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77562024-12-20T22:38:00.990ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
77572024-12-20T22:38:00.990ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5eb912e3-4b24-4bf5-8c4d-7b25cf4b2457", "date": "Fri, 20 Dec 2024 22:38:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
77582024-12-20T22:38:00.990ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
77592024-12-20T22:38:00.991ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6309027a-3e50-4fcb-ab00-5b0bd9ac9ab3", "date": "Fri, 20 Dec 2024 22:38:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
77602024-12-20T22:38:00.991ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
77612024-12-20T22:38:00.993ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8ba78df0-10f5-4d32-bd7a-d0344e917fc9", "date": "Fri, 20 Dec 2024 22:38:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
77622024-12-20T22:38:00.993ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
77632024-12-20T22:38:00.994ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
77642024-12-20T22:38:00.994ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 423.144657ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
77652024-12-20T22:38:00.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 9b5bd3d2-081f-4fdb-8aca-dfe90e398fce roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
77662024-12-20T22:38:00.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 9b5bd3d2-081f-4fdb-8aca-dfe90e398fce resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
77672024-12-20T22:38:00.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 9b5bd3d2-081f-4fdb-8aca-dfe90e398fce response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
77682024-12-20T22:38:01.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0a7d042d-0081-4ea4-a879-4856bc901135 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
77692024-12-20T22:38:01.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0a7d042d-0081-4ea4-a879-4856bc901135 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
77702024-12-20T22:38:01.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0a7d042d-0081-4ea4-a879-4856bc901135 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
77712024-12-20T22:38:01.019ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
77722024-12-20T22:38:01.019ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
77732024-12-20T22:38:01.023ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ce412506-aa3d-4973-ac58-647ea5b539bd", "date": "Fri, 20 Dec 2024 22:38:00 GMT"} })
77742024-12-20T22:38:01.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77752024-12-20T22:38:01.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77762024-12-20T22:38:01.026ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77772024-12-20T22:38:01.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77782024-12-20T22:38:01.027ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77792024-12-20T22:38:01.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77802024-12-20T22:38:01.029ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77812024-12-20T22:38:01.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77822024-12-20T22:38:01.029ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9fedf0d4-8a86-4506-bf93-224faabd5e37, rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b26f0563-25fb-4d7c-8480-dd368ac01105) } rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
77832024-12-20T22:38:01.029ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77842024-12-20T22:38:01.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77852024-12-20T22:38:01.032ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
77862024-12-20T22:38:01.032ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77872024-12-20T22:38:01.032ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3e463aaf-d874-4c12-a9a0-c29c3d97a56a", "date": "Fri, 20 Dec 2024 22:38:00 GMT"} })
77882024-12-20T22:38:01.034ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 460.804057ms iteration = 25 status = {}
77892024-12-20T22:38:01.038ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
77902024-12-20T22:38:01.039ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7b070d9-ed20-493a-bbb7-f5e77dff0c73", "content-length": "134", "date": "Fri, 20 Dec 2024 22:38:00 GMT"} })
77912024-12-20T22:38:01.039ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
77922024-12-20T22:38:01.039ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b26f0563-25fb-4d7c-8480-dd368ac01105
77932024-12-20T22:38:01.039ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
77942024-12-20T22:38:01.039ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
77952024-12-20T22:38:01.039ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77962024-12-20T22:38:01.039ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77972024-12-20T22:38:01.039ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77982024-12-20T22:38:01.039ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77992024-12-20T22:38:01.039ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78002024-12-20T22:38:01.039ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
78012024-12-20T22:38:01.039ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
78022024-12-20T22:38:01.039ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78032024-12-20T22:38:01.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78042024-12-20T22:38:01.042ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
78052024-12-20T22:38:01.042ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9a336d1-f410-4b01-85c3-f54089209974", "content-length": "2", "date": "Fri, 20 Dec 2024 22:38:00 GMT"} })
78062024-12-20T22:38:01.042ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
78072024-12-20T22:38:01.042ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab650168-7a19-45df-96cc-522f31c7d3aa", "content-length": "52", "date": "Fri, 20 Dec 2024 22:38:00 GMT"} })
78082024-12-20T22:38:01.042ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
78092024-12-20T22:38:01.042ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
78102024-12-20T22:38:01.136ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "909febd3-3676-4d8c-8ff3-b2296177a935", "date": "Fri, 20 Dec 2024 22:38:00 GMT"} })
78112024-12-20T22:38:01.136ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch = Switch0
78122024-12-20T22:38:01.136ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
78132024-12-20T22:38:01.136ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e991a837-17a9-4f1c-885b-667a0744dcfd", "content-length": "682", "date": "Fri, 20 Dec 2024 22:38:00 GMT"} })
78142024-12-20T22:38:01.136ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78152024-12-20T22:38:01.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78162024-12-20T22:38:01.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78172024-12-20T22:38:01.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78182024-12-20T22:38:01.143ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78192024-12-20T22:38:01.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78202024-12-20T22:38:01.145ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78212024-12-20T22:38:01.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78222024-12-20T22:38:01.153ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 579.534963ms iteration = 25 status = {}
78232024-12-20T22:38:02.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f7b83591-8f5c-4dd7-9da5-2160fe947938 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78242024-12-20T22:38:02.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f7b83591-8f5c-4dd7-9da5-2160fe947938 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78252024-12-20T22:38:02.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f7b83591-8f5c-4dd7-9da5-2160fe947938 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78262024-12-20T22:38:03.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b3962fcd-9bf7-460a-a6f3-26843f144e42 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78272024-12-20T22:38:03.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b3962fcd-9bf7-460a-a6f3-26843f144e42 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78282024-12-20T22:38:03.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2514 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b3962fcd-9bf7-460a-a6f3-26843f144e42 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78292024-12-20T22:38:04.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cc5b3173-aa3e-4585-8281-fbaf5f9538eb roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78302024-12-20T22:38:04.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cc5b3173-aa3e-4585-8281-fbaf5f9538eb resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78312024-12-20T22:38:04.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cc5b3173-aa3e-4585-8281-fbaf5f9538eb response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78322024-12-20T22:38:05.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1787cc98-ae2d-4790-ad12-8ab5e46868b0 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78332024-12-20T22:38:05.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1787cc98-ae2d-4790-ad12-8ab5e46868b0 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78342024-12-20T22:38:05.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1787cc98-ae2d-4790-ad12-8ab5e46868b0 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78352024-12-20T22:38:05.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = f976bfeb-7fd3-45a4-9bb2-8ecaeb88fddc roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
78362024-12-20T22:38:05.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = f976bfeb-7fd3-45a4-9bb2-8ecaeb88fddc resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
78372024-12-20T22:38:05.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3702 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = f976bfeb-7fd3-45a4-9bb2-8ecaeb88fddc response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
78382024-12-20T22:38:05.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = bbcd6cec-5092-4164-acca-3cfd84036c4b roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
78392024-12-20T22:38:05.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = bbcd6cec-5092-4164-acca-3cfd84036c4b resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
78402024-12-20T22:38:05.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2863 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = bbcd6cec-5092-4164-acca-3cfd84036c4b response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
78412024-12-20T22:38:05.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 504 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = d46021c8-fc17-4e2a-b44e-6cc34d918efc response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
78422024-12-20T22:38:06.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 22a778f6-ce24-4a47-ae57-4fd068065c80 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78432024-12-20T22:38:06.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 22a778f6-ce24-4a47-ae57-4fd068065c80 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78442024-12-20T22:38:06.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2497 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 22a778f6-ce24-4a47-ae57-4fd068065c80 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78452024-12-20T22:38:07.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5b6467e9-03e4-422e-8172-8ee16e2284b8 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78462024-12-20T22:38:07.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5b6467e9-03e4-422e-8172-8ee16e2284b8 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78472024-12-20T22:38:07.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5b6467e9-03e4-422e-8172-8ee16e2284b8 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78482024-12-20T22:38:08.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d72442bb-b3dc-484d-8ac8-35568bd596b7 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78492024-12-20T22:38:08.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d72442bb-b3dc-484d-8ac8-35568bd596b7 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78502024-12-20T22:38:08.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d72442bb-b3dc-484d-8ac8-35568bd596b7 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78512024-12-20T22:38:09.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ba0566ad-94bf-4b25-a416-4d920e48deb5 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78522024-12-20T22:38:09.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ba0566ad-94bf-4b25-a416-4d920e48deb5 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78532024-12-20T22:38:09.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ba0566ad-94bf-4b25-a416-4d920e48deb5 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78542024-12-20T22:38:10.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5466ee63-8294-4282-bf0f-802428bc925f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78552024-12-20T22:38:10.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5466ee63-8294-4282-bf0f-802428bc925f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78562024-12-20T22:38:10.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5466ee63-8294-4282-bf0f-802428bc925f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78572024-12-20T22:38:10.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
78582024-12-20T22:38:10.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78592024-12-20T22:38:10.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78602024-12-20T22:38:10.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
78612024-12-20T22:38:10.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78622024-12-20T22:38:10.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78632024-12-20T22:38:10.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78642024-12-20T22:38:10.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78652024-12-20T22:38:10.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78662024-12-20T22:38:10.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78672024-12-20T22:38:10.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78682024-12-20T22:38:10.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.114203ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78692024-12-20T22:38:10.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78702024-12-20T22:38:10.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78712024-12-20T22:38:10.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78722024-12-20T22:38:10.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78732024-12-20T22:38:10.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
78742024-12-20T22:38:10.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78752024-12-20T22:38:10.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78762024-12-20T22:38:10.595ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
78772024-12-20T22:38:10.595ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.003365ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
78782024-12-20T22:38:11.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 149fac61-4fbd-4aab-a926-1bf2fd216ad6 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78792024-12-20T22:38:11.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 149fac61-4fbd-4aab-a926-1bf2fd216ad6 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78802024-12-20T22:38:11.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 149fac61-4fbd-4aab-a926-1bf2fd216ad6 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78812024-12-20T22:38:12.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2d3772d7-081f-4d48-b899-8f8fb7638121 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78822024-12-20T22:38:12.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2d3772d7-081f-4d48-b899-8f8fb7638121 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78832024-12-20T22:38:12.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1894 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2d3772d7-081f-4d48-b899-8f8fb7638121 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78842024-12-20T22:38:13.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3b3bdcae-f924-44fb-8331-82e1f24c2d4f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78852024-12-20T22:38:13.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3b3bdcae-f924-44fb-8331-82e1f24c2d4f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78862024-12-20T22:38:13.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1966 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3b3bdcae-f924-44fb-8331-82e1f24c2d4f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78872024-12-20T22:38:14.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 01af8333-87d5-4181-8fbe-69741c34edb3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
78882024-12-20T22:38:14.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 01af8333-87d5-4181-8fbe-69741c34edb3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
78892024-12-20T22:38:14.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 01af8333-87d5-4181-8fbe-69741c34edb3 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
78902024-12-20T22:38:14.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = f5afa4cb-1b13-4fc6-8d71-9c50d6dafbbb roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
78912024-12-20T22:38:14.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = f5afa4cb-1b13-4fc6-8d71-9c50d6dafbbb resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
78922024-12-20T22:38:14.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = f5afa4cb-1b13-4fc6-8d71-9c50d6dafbbb response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
78932024-12-20T22:38:14.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 81c6576a-5fc0-44e0-be30-b5923dd8ae68 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78942024-12-20T22:38:14.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 81c6576a-5fc0-44e0-be30-b5923dd8ae68 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78952024-12-20T22:38:14.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 81c6576a-5fc0-44e0-be30-b5923dd8ae68 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78962024-12-20T22:38:15.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 791 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 008c9fc1-44f8-40fb-9246-f646fac5574b response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
78972024-12-20T22:38:15.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b9afe567-eb5e-40e2-97b4-194dc4deeac1 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78982024-12-20T22:38:15.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b9afe567-eb5e-40e2-97b4-194dc4deeac1 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
78992024-12-20T22:38:15.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2653 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b9afe567-eb5e-40e2-97b4-194dc4deeac1 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79002024-12-20T22:38:16.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 23617ea5-397a-442e-ba4e-4db096962eaf roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79012024-12-20T22:38:16.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 23617ea5-397a-442e-ba4e-4db096962eaf resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79022024-12-20T22:38:16.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 23617ea5-397a-442e-ba4e-4db096962eaf response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79032024-12-20T22:38:17.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7467e726-6c0a-412b-9a9b-146497abd6b2 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79042024-12-20T22:38:17.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7467e726-6c0a-412b-9a9b-146497abd6b2 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79052024-12-20T22:38:17.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2538 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7467e726-6c0a-412b-9a9b-146497abd6b2 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79062024-12-20T22:38:18.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9e6c70d5-1fc0-4937-bae4-cc97aa6139dc roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79072024-12-20T22:38:18.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9e6c70d5-1fc0-4937-bae4-cc97aa6139dc resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79082024-12-20T22:38:18.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2662 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9e6c70d5-1fc0-4937-bae4-cc97aa6139dc response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79092024-12-20T22:38:19.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fccd2040-eb8d-439e-85cc-94dc571f417b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79102024-12-20T22:38:19.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fccd2040-eb8d-439e-85cc-94dc571f417b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79112024-12-20T22:38:19.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fccd2040-eb8d-439e-85cc-94dc571f417b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79122024-12-20T22:38:20.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f99ec0ad-9a10-4b74-9e1e-d40bd1e3505b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79132024-12-20T22:38:20.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f99ec0ad-9a10-4b74-9e1e-d40bd1e3505b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79142024-12-20T22:38:20.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f99ec0ad-9a10-4b74-9e1e-d40bd1e3505b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79152024-12-20T22:38:20.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
79162024-12-20T22:38:20.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79172024-12-20T22:38:20.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79182024-12-20T22:38:20.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
79192024-12-20T22:38:20.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79202024-12-20T22:38:20.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79212024-12-20T22:38:20.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79222024-12-20T22:38:20.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79232024-12-20T22:38:20.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79242024-12-20T22:38:20.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.036271ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79252024-12-20T22:38:20.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79262024-12-20T22:38:20.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79272024-12-20T22:38:20.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79282024-12-20T22:38:20.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79292024-12-20T22:38:20.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79302024-12-20T22:38:20.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79312024-12-20T22:38:20.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
79322024-12-20T22:38:20.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79332024-12-20T22:38:20.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79342024-12-20T22:38:20.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
79352024-12-20T22:38:20.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.865818ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
79362024-12-20T22:38:21.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 30d8c88c-a5de-434f-b4f8-b5994fe87274 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79372024-12-20T22:38:21.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 30d8c88c-a5de-434f-b4f8-b5994fe87274 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79382024-12-20T22:38:21.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 30d8c88c-a5de-434f-b4f8-b5994fe87274 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79392024-12-20T22:38:22.000ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793 remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5dd10559-1c85-4d2a-97ab-17e590d1f854 uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-20T22:38:21.983738128Z }
79402024-12-20T22:38:22.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5dd10559-1c85-4d2a-97ab-17e590d1f854 roles = RoleSet { roles: {} } uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
79412024-12-20T22:38:22.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5dd10559-1c85-4d2a-97ab-17e590d1f854 resource = Database result = Ok(()) uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
79422024-12-20T22:38:22.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30111 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5dd10559-1c85-4d2a-97ab-17e590d1f854 response_code = 204 uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
79432024-12-20T22:38:22.014ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793 remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c4dcee72-e930-4578-bc25-76c6f3ddabc4 uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-20T22:38:22.014355093Z }
79442024-12-20T22:38:22.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c4dcee72-e930-4578-bc25-76c6f3ddabc4 roles = RoleSet { roles: {} } uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
79452024-12-20T22:38:22.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c4dcee72-e930-4578-bc25-76c6f3ddabc4 resource = Database result = Ok(()) uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
79462024-12-20T22:38:22.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9505 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c4dcee72-e930-4578-bc25-76c6f3ddabc4 response_code = 204 uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
79472024-12-20T22:38:22.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7c4ce906-8ff3-4bfa-910f-597221dcef34 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79482024-12-20T22:38:22.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7c4ce906-8ff3-4bfa-910f-597221dcef34 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79492024-12-20T22:38:22.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7c4ce906-8ff3-4bfa-910f-597221dcef34 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79502024-12-20T22:38:23.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 95804304-cd82-486c-9b9d-616cb92ea57f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79512024-12-20T22:38:23.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 95804304-cd82-486c-9b9d-616cb92ea57f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79522024-12-20T22:38:23.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 95804304-cd82-486c-9b9d-616cb92ea57f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79532024-12-20T22:38:24.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b509c932-ffe1-40e4-b00e-80a66768c048 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79542024-12-20T22:38:24.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b509c932-ffe1-40e4-b00e-80a66768c048 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79552024-12-20T22:38:24.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b509c932-ffe1-40e4-b00e-80a66768c048 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79562024-12-20T22:38:25.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 688 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 2edf8789-96db-4ef0-8541-1d9de50249b4 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
79572024-12-20T22:38:25.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ecc6882d-92c8-4018-9c8e-16e0c7870a96 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79582024-12-20T22:38:25.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ecc6882d-92c8-4018-9c8e-16e0c7870a96 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79592024-12-20T22:38:25.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ecc6882d-92c8-4018-9c8e-16e0c7870a96 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79602024-12-20T22:38:26.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 90c71965-1587-4e98-baef-9cf62e9a83bd roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79612024-12-20T22:38:26.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 90c71965-1587-4e98-baef-9cf62e9a83bd resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79622024-12-20T22:38:26.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 90c71965-1587-4e98-baef-9cf62e9a83bd response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79632024-12-20T22:38:27.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6fba2e9d-a828-433f-a9c2-3b734819ac46 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79642024-12-20T22:38:27.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6fba2e9d-a828-433f-a9c2-3b734819ac46 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79652024-12-20T22:38:27.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6fba2e9d-a828-433f-a9c2-3b734819ac46 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79662024-12-20T22:38:28.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d15da418-d320-408a-9a82-f8bbabdd16af roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79672024-12-20T22:38:28.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d15da418-d320-408a-9a82-f8bbabdd16af resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79682024-12-20T22:38:28.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d15da418-d320-408a-9a82-f8bbabdd16af response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79692024-12-20T22:38:29.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cad47c44-3541-44cd-af7f-0144e03e1495 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79702024-12-20T22:38:29.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cad47c44-3541-44cd-af7f-0144e03e1495 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79712024-12-20T22:38:29.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cad47c44-3541-44cd-af7f-0144e03e1495 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
79722024-12-20T22:38:30.570ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
79732024-12-20T22:38:30.571ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
79742024-12-20T22:38:30.571ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
79752024-12-20T22:38:30.571ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
79762024-12-20T22:38:30.571ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
79772024-12-20T22:38:30.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
79782024-12-20T22:38:30.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
79792024-12-20T22:38:30.571ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
79802024-12-20T22:38:30.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79812024-12-20T22:38:30.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79822024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
79832024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
79842024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79852024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
79862024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
79872024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79882024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
79892024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
79902024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79912024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
79922024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79932024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
79942024-12-20T22:38:30.573ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
79952024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
79962024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
79972024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79982024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79992024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80002024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
80012024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
80022024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
80032024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80042024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
80052024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80062024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
80072024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80082024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
80092024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80102024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
80112024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
80122024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80132024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80142024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80152024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80162024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80172024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80182024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80192024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
80202024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80212024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80222024-12-20T22:38:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80232024-12-20T22:38:30.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1458, tv_nsec: 186624502 } })
80242024-12-20T22:38:30.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1458, tv_nsec: 186839488 } })
80252024-12-20T22:38:30.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
80262024-12-20T22:38:30.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
80272024-12-20T22:38:30.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80282024-12-20T22:38:30.574ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.076183ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
80292024-12-20T22:38:30.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80302024-12-20T22:38:30.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80312024-12-20T22:38:30.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80322024-12-20T22:38:30.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80332024-12-20T22:38:30.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80342024-12-20T22:38:30.578ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80352024-12-20T22:38:30.578ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
80362024-12-20T22:38:30.578ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80372024-12-20T22:38:30.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80382024-12-20T22:38:30.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80392024-12-20T22:38:30.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80402024-12-20T22:38:30.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80412024-12-20T22:38:30.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
80422024-12-20T22:38:30.582ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80432024-12-20T22:38:30.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80442024-12-20T22:38:30.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80452024-12-20T22:38:30.584ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80462024-12-20T22:38:30.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
80472024-12-20T22:38:30.584ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80482024-12-20T22:38:30.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80492024-12-20T22:38:30.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80502024-12-20T22:38:30.585ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80512024-12-20T22:38:30.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80522024-12-20T22:38:30.586ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.109871ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80532024-12-20T22:38:30.588ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80542024-12-20T22:38:30.588ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80552024-12-20T22:38:30.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
80562024-12-20T22:38:30.588ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80572024-12-20T22:38:30.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80582024-12-20T22:38:30.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80592024-12-20T22:38:30.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80602024-12-20T22:38:30.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80612024-12-20T22:38:30.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80622024-12-20T22:38:30.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80632024-12-20T22:38:30.594ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1458, tv_nsec: 206793589 } })
80642024-12-20T22:38:30.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80652024-12-20T22:38:30.594ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
80662024-12-20T22:38:30.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
80672024-12-20T22:38:30.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80682024-12-20T22:38:30.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80692024-12-20T22:38:30.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80702024-12-20T22:38:30.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80712024-12-20T22:38:30.599ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80722024-12-20T22:38:30.599ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
80732024-12-20T22:38:30.599ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80742024-12-20T22:38:30.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80752024-12-20T22:38:30.615ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
80762024-12-20T22:38:30.615ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.117059ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
80772024-12-20T22:38:30.624ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80782024-12-20T22:38:30.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80792024-12-20T22:38:30.628ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80802024-12-20T22:38:30.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80812024-12-20T22:38:30.633ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.49819ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
80822024-12-20T22:38:30.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.247346ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
80832024-12-20T22:38:30.637ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
80842024-12-20T22:38:30.637ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80852024-12-20T22:38:30.638ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b0c627e-13d2-482c-bfe6-37f6182590ed", "content-length": "26", "date": "Fri, 20 Dec 2024 22:38:30 GMT"} })
80862024-12-20T22:38:30.638ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80872024-12-20T22:38:30.639ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80882024-12-20T22:38:30.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80892024-12-20T22:38:30.640ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80902024-12-20T22:38:30.644ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80912024-12-20T22:38:30.645ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80922024-12-20T22:38:30.646ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
80932024-12-20T22:38:30.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
80942024-12-20T22:38:30.647ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80952024-12-20T22:38:30.647ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80962024-12-20T22:38:30.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80972024-12-20T22:38:30.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80982024-12-20T22:38:30.648ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80992024-12-20T22:38:30.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81002024-12-20T22:38:30.649ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81012024-12-20T22:38:30.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81022024-12-20T22:38:30.650ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 77.21113ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
81032024-12-20T22:38:30.650ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
81042024-12-20T22:38:30.650ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81052024-12-20T22:38:30.651ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ee120ad-a245-42c4-9fb5-4003d27e5b8c", "content-length": "26", "date": "Fri, 20 Dec 2024 22:38:30 GMT"} })
81062024-12-20T22:38:30.651ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81072024-12-20T22:38:30.652ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81082024-12-20T22:38:30.660ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81092024-12-20T22:38:30.660ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
81102024-12-20T22:38:30.660ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 87.295009ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
81112024-12-20T22:38:30.669ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 zone_address = fd00:1122:3344:101::2
81122024-12-20T22:38:30.669ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81132024-12-20T22:38:30.669ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "90afa0d4-1140-436f-9423-ed9450f6aefc", "content-length": "26", "date": "Fri, 20 Dec 2024 22:38:30 GMT"} })
81142024-12-20T22:38:30.669ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81152024-12-20T22:38:30.671ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
81162024-12-20T22:38:30.682ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81172024-12-20T22:38:30.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
81182024-12-20T22:38:30.684ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81192024-12-20T22:38:30.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81202024-12-20T22:38:30.687ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 113.988745ms iteration = 26 status = 0
81212024-12-20T22:38:30.695ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 122.704046ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
81222024-12-20T22:38:30.697ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81232024-12-20T22:38:30.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81242024-12-20T22:38:30.738ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 164.814228ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
81252024-12-20T22:38:30.751ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81262024-12-20T22:38:30.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81272024-12-20T22:38:30.777ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
81282024-12-20T22:38:30.778ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8a94381-12a1-41fa-a1c4-0f9e689700a3", "content-length": "1", "date": "Fri, 20 Dec 2024 22:38:30 GMT"} })
81292024-12-20T22:38:30.779ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81302024-12-20T22:38:30.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81312024-12-20T22:38:30.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0f9f9c50-8324-401a-876d-0c5ebebe147e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
81322024-12-20T22:38:30.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0f9f9c50-8324-401a-876d-0c5ebebe147e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
81332024-12-20T22:38:30.799ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 226.155561ms iteration = 29 status = {"physical_disks_added":0}
81342024-12-20T22:38:30.878ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 307.570307ms iteration = 26 status = {}
81352024-12-20T22:38:30.882ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
81362024-12-20T22:38:30.882ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81372024-12-20T22:38:30.882ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fcad3c6-5261-4501-9279-3e343dc4da1e", "content-length": "583", "date": "Fri, 20 Dec 2024 22:38:30 GMT"} })
81382024-12-20T22:38:30.883ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81392024-12-20T22:38:30.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81402024-12-20T22:38:30.883ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793/state
81412024-12-20T22:38:30.884ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "b70a4da9-e039-44c2-9a70-1c95c2a683ec", "content-length": "130", "date": "Fri, 20 Dec 2024 22:38:30 GMT"} })
81422024-12-20T22:38:30.885ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 314.933111ms iteration = 26 status = null
81432024-12-20T22:38:30.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0f9f9c50-8324-401a-876d-0c5ebebe147e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
81442024-12-20T22:38:30.888ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e sled_id = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-20T22:38:22.014355093Z }, migration_in: None, migration_out: None } vmm_id = 5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
81452024-12-20T22:38:30.888ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2077 instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793 sled_id = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 vmm_id = 5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-20T22:38:22.014355093Z }
81462024-12-20T22:38:30.888ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e roles = RoleSet { roles: {} } sled_id = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 vmm_id = 5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
81472024-12-20T22:38:30.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e resource = Database result = Ok(()) sled_id = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 vmm_id = 5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
81482024-12-20T22:38:30.900ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {14251541-ccc2-46a6-b4c4-eedae5d2650f: {10.151.1.175: {ec773473-5c6d-4c0f-8c23-3b3a1177ca5c}, 10.151.1.176: {ec773473-5c6d-4c0f-8c23-3b3a1177ca5c}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
81492024-12-20T22:38:30.900ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
81502024-12-20T22:38:30.900ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a56114ab-1ec4-4354-b7c9-630523018ae2", "date": "Fri, 20 Dec 2024 22:38:30 GMT"} })
81512024-12-20T22:38:30.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81522024-12-20T22:38:30.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81532024-12-20T22:38:30.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81542024-12-20T22:38:30.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81552024-12-20T22:38:30.906ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81562024-12-20T22:38:30.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81572024-12-20T22:38:30.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81582024-12-20T22:38:30.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81592024-12-20T22:38:30.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81602024-12-20T22:38:30.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81612024-12-20T22:38:30.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81622024-12-20T22:38:30.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81632024-12-20T22:38:30.917ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
81642024-12-20T22:38:30.917ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
81652024-12-20T22:38:30.917ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81662024-12-20T22:38:30.917ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b2f52f34-4987-4b97-8c1e-26317773bf70", "date": "Fri, 20 Dec 2024 22:38:30 GMT"} })
81672024-12-20T22:38:30.918ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 345.616358ms iteration = 26 status = {}
81682024-12-20T22:38:30.927ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81692024-12-20T22:38:30.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81702024-12-20T22:38:30.929ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9fedf0d4-8a86-4506-bf93-224faabd5e37, rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b26f0563-25fb-4d7c-8480-dd368ac01105) } rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
81712024-12-20T22:38:30.929ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81722024-12-20T22:38:30.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81732024-12-20T22:38:30.939ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
81742024-12-20T22:38:30.939ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe90dcb4-e880-4ea6-a947-8267c7530119", "content-length": "134", "date": "Fri, 20 Dec 2024 22:38:30 GMT"} })
81752024-12-20T22:38:30.939ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
81762024-12-20T22:38:30.939ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b26f0563-25fb-4d7c-8480-dd368ac01105
81772024-12-20T22:38:30.939ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
81782024-12-20T22:38:30.939ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
81792024-12-20T22:38:30.939ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81802024-12-20T22:38:30.939ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81812024-12-20T22:38:30.939ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81822024-12-20T22:38:30.939ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81832024-12-20T22:38:30.940ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81842024-12-20T22:38:30.940ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81852024-12-20T22:38:30.940ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
81862024-12-20T22:38:30.940ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81872024-12-20T22:38:30.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81882024-12-20T22:38:30.940ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
81892024-12-20T22:38:30.942ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 369.013663ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
81902024-12-20T22:38:30.942ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
81912024-12-20T22:38:30.942ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c3af155-6215-4365-b7c6-cd34b71b2743", "content-length": "2", "date": "Fri, 20 Dec 2024 22:38:30 GMT"} })
81922024-12-20T22:38:30.942ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
81932024-12-20T22:38:30.942ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbd1911a-2620-4f3a-a3b5-d936b223f198", "content-length": "52", "date": "Fri, 20 Dec 2024 22:38:30 GMT"} })
81942024-12-20T22:38:30.942ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
81952024-12-20T22:38:30.942ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
81962024-12-20T22:38:31.022ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81972024-12-20T22:38:31.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81982024-12-20T22:38:31.023ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81992024-12-20T22:38:31.025ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82002024-12-20T22:38:31.025ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82012024-12-20T22:38:31.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82022024-12-20T22:38:31.027ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82032024-12-20T22:38:31.029ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82042024-12-20T22:38:31.029ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82052024-12-20T22:38:31.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82062024-12-20T22:38:31.048ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "48bac970-fa62-4e45-bb2b-2110ea019922", "date": "Fri, 20 Dec 2024 22:38:30 GMT"} })
82072024-12-20T22:38:31.048ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch = Switch0
82082024-12-20T22:38:31.048ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
82092024-12-20T22:38:31.048ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "be71c912-56b0-426e-bbde-8babd27245f8", "content-length": "682", "date": "Fri, 20 Dec 2024 22:38:30 GMT"} })
82102024-12-20T22:38:31.048ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82112024-12-20T22:38:31.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82122024-12-20T22:38:31.052ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82132024-12-20T22:38:31.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82142024-12-20T22:38:31.055ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82152024-12-20T22:38:31.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82162024-12-20T22:38:31.057ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82172024-12-20T22:38:31.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82182024-12-20T22:38:31.063ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
82192024-12-20T22:38:31.063ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "efe11e56-66a8-4611-9eae-ffd0b31dbf8b", "content-length": "810", "date": "Fri, 20 Dec 2024 22:38:30 GMT"} })
82202024-12-20T22:38:31.064ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(5279387) }} sled = buskin
82212024-12-20T22:38:31.064ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
82222024-12-20T22:38:31.064ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
82232024-12-20T22:38:31.064ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 491.447312ms iteration = 26 status = {}
82242024-12-20T22:38:31.065ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 492.105531ms iteration = 26 status = {}
82252024-12-20T22:38:31.587ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793 remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cf957d54-f16d-4aaa-b8db-8ba71276988a uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-20T22:38:31.587122142Z }
82262024-12-20T22:38:31.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cf957d54-f16d-4aaa-b8db-8ba71276988a roles = RoleSet { roles: {} } uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82272024-12-20T22:38:31.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cf957d54-f16d-4aaa-b8db-8ba71276988a resource = Database result = Ok(()) uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82282024-12-20T22:38:31.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27198 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = cf957d54-f16d-4aaa-b8db-8ba71276988a response_code = 204 uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82292024-12-20T22:38:31.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8d90cc0d-d7a2-4b4b-be5a-f29ac87b4d37 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
82302024-12-20T22:38:31.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8d90cc0d-d7a2-4b4b-be5a-f29ac87b4d37 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
82312024-12-20T22:38:31.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8d90cc0d-d7a2-4b4b-be5a-f29ac87b4d37 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
82322024-12-20T22:38:32.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = d4bcb47a-09c9-48e9-a1ad-07d66b166244 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
82332024-12-20T22:38:32.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = d4bcb47a-09c9-48e9-a1ad-07d66b166244 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
82342024-12-20T22:38:32.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = d4bcb47a-09c9-48e9-a1ad-07d66b166244 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
82352024-12-20T22:38:32.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = b27ee574-1158-4a08-a100-e27ed1c48125 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
82362024-12-20T22:38:32.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = b27ee574-1158-4a08-a100-e27ed1c48125 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
82372024-12-20T22:38:32.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = b27ee574-1158-4a08-a100-e27ed1c48125 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
82382024-12-20T22:38:32.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 57d4a77e-1d58-49c5-b685-e779f4837ab7 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
82392024-12-20T22:38:32.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 57d4a77e-1d58-49c5-b685-e779f4837ab7 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
82402024-12-20T22:38:32.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 57d4a77e-1d58-49c5-b685-e779f4837ab7 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
82412024-12-20T22:38:33.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1a2f1ba2-a3c5-44d3-b672-9483627e79ba roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
82422024-12-20T22:38:33.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1a2f1ba2-a3c5-44d3-b672-9483627e79ba resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
82432024-12-20T22:38:33.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2699 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1a2f1ba2-a3c5-44d3-b672-9483627e79ba response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
82442024-12-20T22:38:34.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = a2a02b96-ed19-4e96-9e35-4a460434145c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
82452024-12-20T22:38:34.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = a2a02b96-ed19-4e96-9e35-4a460434145c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
82462024-12-20T22:38:34.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3623 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = a2a02b96-ed19-4e96-9e35-4a460434145c response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
82472024-12-20T22:38:34.155ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793 remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19c7e60b-0337-42f6-86f6-05609a4a4cba uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-20T22:38:34.154770490Z }
82482024-12-20T22:38:34.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19c7e60b-0337-42f6-86f6-05609a4a4cba roles = RoleSet { roles: {} } uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82492024-12-20T22:38:34.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19c7e60b-0337-42f6-86f6-05609a4a4cba resource = Database result = Ok(()) uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82502024-12-20T22:38:34.216ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793 remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19c7e60b-0337-42f6-86f6-05609a4a4cba uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793 vmm_needs_update = true
82512024-12-20T22:38:34.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19c7e60b-0337-42f6-86f6-05609a4a4cba roles = RoleSet { roles: {} } uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82522024-12-20T22:38:34.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19c7e60b-0337-42f6-86f6-05609a4a4cba resource = Database result = Ok(()) uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82532024-12-20T22:38:34.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19c7e60b-0337-42f6-86f6-05609a4a4cba roles = RoleSet { roles: {} } uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82542024-12-20T22:38:34.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19c7e60b-0337-42f6-86f6-05609a4a4cba resource = Database result = Ok(()) uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82552024-12-20T22:38:34.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19c7e60b-0337-42f6-86f6-05609a4a4cba roles = RoleSet { roles: {} } uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82562024-12-20T22:38:34.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19c7e60b-0337-42f6-86f6-05609a4a4cba resource = Database result = Ok(()) uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82572024-12-20T22:38:34.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19c7e60b-0337-42f6-86f6-05609a4a4cba roles = RoleSet { roles: {} } uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82582024-12-20T22:38:34.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19c7e60b-0337-42f6-86f6-05609a4a4cba resource = Database result = Ok(()) uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82592024-12-20T22:38:34.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19c7e60b-0337-42f6-86f6-05609a4a4cba roles = RoleSet { roles: {} } uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82602024-12-20T22:38:34.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19c7e60b-0337-42f6-86f6-05609a4a4cba resource = Database result = Ok(()) uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82612024-12-20T22:38:34.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19c7e60b-0337-42f6-86f6-05609a4a4cba roles = RoleSet { roles: {} } uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82622024-12-20T22:38:34.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19c7e60b-0337-42f6-86f6-05609a4a4cba resource = Database result = Ok(()) uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82632024-12-20T22:38:34.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19c7e60b-0337-42f6-86f6-05609a4a4cba roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82642024-12-20T22:38:34.282ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19c7e60b-0337-42f6-86f6-05609a4a4cba resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: e1a624a4-dfde-423b-a38d-470dfb011cc3, lookup_type: ById(e1a624a4-dfde-423b-a38d-470dfb011cc3) }, key: 8a281822-6c2e-4e5f-8d97-8acc1d71824b, lookup_type: ById(8a281822-6c2e-4e5f-8d97-8acc1d71824b) }, key: b217f28e-649a-4e88-87bd-154b1b9a793e, lookup_type: ById(b217f28e-649a-4e88-87bd-154b1b9a793e) } result = Ok(()) uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82652024-12-20T22:38:34.300ZINFOnexus (dropshot_internal): starting update saga for b217f28e-649a-4e88-87bd-154b1b9a793e actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1544 instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19c7e60b-0337-42f6-86f6-05609a4a4cba uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-20T22:38:34.154770490Z }
82662024-12-20T22:38:34.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145604 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19c7e60b-0337-42f6-86f6-05609a4a4cba response_code = 204 uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82672024-12-20T22:38:34.300ZDEBGnexus (dropshot_internal): preparing instance-update saga for b217f28e-649a-4e88-87bd-154b1b9a793e... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 19c7e60b-0337-42f6-86f6-05609a4a4cba uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82682024-12-20T22:38:34.300ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update
82692024-12-20T22:38:34.301ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793 remote_addr = [fd00:1122:3344:101::1]:63920 req_id = dc513408-c679-4600-bcdc-d29ee0376619 uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-20T22:38:34.154770490Z }
82702024-12-20T22:38:34.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = dc513408-c679-4600-bcdc-d29ee0376619 roles = RoleSet { roles: {} } uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82712024-12-20T22:38:34.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = dc513408-c679-4600-bcdc-d29ee0376619 resource = Database result = Ok(()) uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82722024-12-20T22:38:34.307ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"b217f28e-649a-4e88-87bd-154b1b9a793e","lookup_type":{"ById":"b217f28e-649a-4e88-87bd-154b1b9a793e"},"parent":{"key":"8a281822-6c2e-4e5f-8d97-8acc1d71824b","lookup_type":{"ById":"8a281822-6c2e-4e5f-8d97-8acc1d71824b"},"parent":{"key":"e1a624a4-dfde-423b-a38d-470dfb011cc3","lookup_type":{"ById":"e1a624a4-dfde-423b-a38d-470dfb011cc3"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
82732024-12-20T22:38:34.307ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update
82742024-12-20T22:38:34.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7264 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63920 req_id = dc513408-c679-4600-bcdc-d29ee0376619 response_code = 204 uri = /vmms/5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793
82752024-12-20T22:38:34.372ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update
82762024-12-20T22:38:34.372ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
82772024-12-20T22:38:34.374ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
82782024-12-20T22:38:34.374ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a
82792024-12-20T22:38:34.390ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
82802024-12-20T22:38:34.390ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a
82812024-12-20T22:38:34.398ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
82822024-12-20T22:38:34.398ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a
82832024-12-20T22:38:34.409ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
82842024-12-20T22:38:34.409ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("08942af3-c00b-4a6e-919d-26494f1b524d")) node_id = 0 saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a
82852024-12-20T22:38:34.416ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
82862024-12-20T22:38:34.416ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a
82872024-12-20T22:38:34.439ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update
82882024-12-20T22:38:34.441ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = LockInstance
82892024-12-20T22:38:34.442ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = LockInstance
82902024-12-20T22:38:34.444ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = LockInstance
82912024-12-20T22:38:34.444ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = LockInstance
82922024-12-20T22:38:34.447ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = LockInstance
82932024-12-20T22:38:34.448ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = LockInstance
82942024-12-20T22:38:34.459ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = LockInstance
82952024-12-20T22:38:34.459ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = LockInstance
82962024-12-20T22:38:34.460ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = LockInstance
82972024-12-20T22:38:34.460ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = LockInstance
82982024-12-20T22:38:34.462ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = LockInstance
82992024-12-20T22:38:34.462ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = LockInstance
83002024-12-20T22:38:34.464ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = LockInstance
83012024-12-20T22:38:34.471ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: e1a624a4-dfde-423b-a38d-470dfb011cc3, lookup_type: ById(e1a624a4-dfde-423b-a38d-470dfb011cc3) }, key: 8a281822-6c2e-4e5f-8d97-8acc1d71824b, lookup_type: ById(8a281822-6c2e-4e5f-8d97-8acc1d71824b) }, key: b217f28e-649a-4e88-87bd-154b1b9a793e, lookup_type: ById(b217f28e-649a-4e88-87bd-154b1b9a793e) } result = Ok(()) saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = LockInstance
83022024-12-20T22:38:34.471ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = LockInstance updater_id = 08942af3-c00b-4a6e-919d-26494f1b524d
83032024-12-20T22:38:34.471ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = LockInstance
83042024-12-20T22:38:34.471ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = LockInstance
83052024-12-20T22:38:34.563ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = LockInstance updater_id = 08942af3-c00b-4a6e-919d-26494f1b524d
83062024-12-20T22:38:34.563ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = LockInstance
83072024-12-20T22:38:34.563ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = LockInstance
83082024-12-20T22:38:34.568ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e locked_gen = Generation(Generation(2)) saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = LockInstance updater_id = 08942af3-c00b-4a6e-919d-26494f1b524d
83092024-12-20T22:38:34.570ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
83102024-12-20T22:38:34.570ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("08942af3-c00b-4a6e-919d-26494f1b524d")}) node_id = 1 saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a
83112024-12-20T22:38:34.591ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
83122024-12-20T22:38:34.591ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a
83132024-12-20T22:38:34.609ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
83142024-12-20T22:38:34.610ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
83152024-12-20T22:38:34.612ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
83162024-12-20T22:38:34.612ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
83172024-12-20T22:38:34.613ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
83182024-12-20T22:38:34.614ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
83192024-12-20T22:38:34.615ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
83202024-12-20T22:38:34.618ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: e1a624a4-dfde-423b-a38d-470dfb011cc3, lookup_type: ById(e1a624a4-dfde-423b-a38d-470dfb011cc3) }, key: 8a281822-6c2e-4e5f-8d97-8acc1d71824b, lookup_type: ById(8a281822-6c2e-4e5f-8d97-8acc1d71824b) }, key: b217f28e-649a-4e88-87bd-154b1b9a793e, lookup_type: ById(b217f28e-649a-4e88-87bd-154b1b9a793e) } result = Ok(()) saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
83212024-12-20T22:38:34.618ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
83222024-12-20T22:38:34.619ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
83232024-12-20T22:38:34.634ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793, time_created: 2024-12-20T22:38:13.233547Z, time_deleted: None, instance_id: b217f28e-649a-4e88-87bd-154b1b9a793e, sled_id: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-12-20T22:38:34.154770Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-12-20T22:38:10.833467Z, gen: Generation(Generation(3)), propolis_id: Some(5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-12-20T22:38:34.632442651Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
83242024-12-20T22:38:34.637ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update
83252024-12-20T22:38:34.639ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"b217f28e-649a-4e88-87bd-154b1b9a793e","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"b217f28e-649a-4e88-87bd-154b1b9a793e","lookup_type":{"ById":"b217f28e-649a-4e88-87bd-154b1b9a793e"},"parent":{"key":"8a281822-6c2e-4e5f-8d97-8acc1d71824b","lookup_type":{"ById":"8a281822-6c2e-4e5f-8d97-8acc1d71824b"},"parent":{"key":"e1a624a4-dfde-423b-a38d-470dfb011cc3","lookup_type":{"ById":"e1a624a4-dfde-423b-a38d-470dfb011cc3"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"08942af3-c00b-4a6e-919d-26494f1b524d"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"8a281822-6c2e-4e5f-8d97-8acc1d71824b","ram_diff":1073741824},"destroy_active_vmm":"5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-12-20T22:38:34.632442651Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
83262024-12-20T22:38:34.639ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update
83272024-12-20T22:38:34.657ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update
83282024-12-20T22:38:34.657ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
83292024-12-20T22:38:34.657ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
83302024-12-20T22:38:34.657ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
83312024-12-20T22:38:34.683ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
83322024-12-20T22:38:34.683ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
83332024-12-20T22:38:34.704ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
83342024-12-20T22:38:34.704ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
83352024-12-20T22:38:34.725ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
83362024-12-20T22:38:34.725ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("f574c260-7098-4029-ac0c-aee79796c9c0")) node_id = 0 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
83372024-12-20T22:38:34.755ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
83382024-12-20T22:38:34.755ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
83392024-12-20T22:38:34.780ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e parent_lock = UpdaterLock { updater_id: 08942af3-c00b-4a6e-919d-26494f1b524d, locked_gen: Generation(Generation(2)) } saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update
83402024-12-20T22:38:34.780ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = BecomeUpdater
83412024-12-20T22:38:34.780ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = BecomeUpdater
83422024-12-20T22:38:34.865ZDEBGnexus (SagaExecutor): inherited lock from 08942af3-c00b-4a6e-919d-26494f1b524d to f574c260-7098-4029-ac0c-aee79796c9c0 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 08942af3-c00b-4a6e-919d-26494f1b524d saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = BecomeUpdater updater_id = f574c260-7098-4029-ac0c-aee79796c9c0
83432024-12-20T22:38:34.865ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update
83442024-12-20T22:38:34.865ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
83452024-12-20T22:38:34.865ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("f574c260-7098-4029-ac0c-aee79796c9c0")}) node_id = 1 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
83462024-12-20T22:38:34.892ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
83472024-12-20T22:38:34.892ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
83482024-12-20T22:38:34.944ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
83492024-12-20T22:38:34.944ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
83502024-12-20T22:38:34.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a2a8cb00-f34d-4d9d-a9c7-dc56e17dd75c roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
83512024-12-20T22:38:34.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a2a8cb00-f34d-4d9d-a9c7-dc56e17dd75c resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
83522024-12-20T22:38:34.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a2a8cb00-f34d-4d9d-a9c7-dc56e17dd75c response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
83532024-12-20T22:38:34.977ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
83542024-12-20T22:38:34.977ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
83552024-12-20T22:38:35.004ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update
83562024-12-20T22:38:35.013ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e
83572024-12-20T22:38:35.013ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = UpdateNetworkConfig
83582024-12-20T22:38:35.013ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = UpdateNetworkConfig
83592024-12-20T22:38:35.018ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = UpdateNetworkConfig
83602024-12-20T22:38:35.019ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = UpdateNetworkConfig
83612024-12-20T22:38:35.023ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
83622024-12-20T22:38:35.023ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = UpdateNetworkConfig
83632024-12-20T22:38:35.023ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = UpdateNetworkConfig
83642024-12-20T22:38:35.026ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
83652024-12-20T22:38:35.026ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
83662024-12-20T22:38:35.026ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
83672024-12-20T22:38:35.027ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
83682024-12-20T22:38:35.028ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
83692024-12-20T22:38:35.028ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
83702024-12-20T22:38:35.029ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
83712024-12-20T22:38:35.033ZDEBGnexus: notifying dendrite of updates instance_id = Some(b217f28e-649a-4e88-87bd-154b1b9a793e (instance)) switch = switch0
83722024-12-20T22:38:35.034ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1462, tv_nsec: 646511177 } })
83732024-12-20T22:38:35.034ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
83742024-12-20T22:38:35.065ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
83752024-12-20T22:38:35.065ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83762024-12-20T22:38:35.067ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e561491-634b-4db7-a72c-96fe0829a0a4", "content-length": "26", "date": "Fri, 20 Dec 2024 22:38:35 GMT"} })
83772024-12-20T22:38:35.067ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83782024-12-20T22:38:35.068ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83792024-12-20T22:38:35.098ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
83802024-12-20T22:38:35.098ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "836235f2-ecd7-4434-b088-5ab29ca485ec", "content-length": "4", "date": "Fri, 20 Dec 2024 22:38:34 GMT"} })
83812024-12-20T22:38:35.099ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
83822024-12-20T22:38:35.099ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
83832024-12-20T22:38:35.114ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
83842024-12-20T22:38:35.114ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
83852024-12-20T22:38:35.131ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
83862024-12-20T22:38:35.131ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
83872024-12-20T22:38:35.180ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-12-20T22:38:35.134546Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 8a281822-6c2e-4e5f-8d97-8acc1d71824b, time_modified: Some(2024-12-20T22:38:35.134546Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, time_modified: Some(2024-12-20T22:38:35.134546Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update
83882024-12-20T22:38:35.180ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
83892024-12-20T22:38:35.180ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
83902024-12-20T22:38:35.200ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
83912024-12-20T22:38:35.200ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
83922024-12-20T22:38:35.216ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update
83932024-12-20T22:38:35.216ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = UnassignOximeterProducer
83942024-12-20T22:38:35.216ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = UnassignOximeterProducer
83952024-12-20T22:38:35.236ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = a0c68cf7-84ce-4a59-a3f9-ff7d332963b9 producer_id = b217f28e-649a-4e88-87bd-154b1b9a793e saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update
83962024-12-20T22:38:35.236ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = UnassignOximeterProducer
83972024-12-20T22:38:35.236ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = UnassignOximeterProducer
83982024-12-20T22:38:35.272ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = b217f28e-649a-4e88-87bd-154b1b9a793e saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update
83992024-12-20T22:38:35.276ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = b217f28e-649a-4e88-87bd-154b1b9a793e saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/b217f28e-649a-4e88-87bd-154b1b9a793e
84002024-12-20T22:38:35.305ZDEBGnexus (SagaExecutor): client response oximeter-collector = b217f28e-649a-4e88-87bd-154b1b9a793e result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/b217f28e-649a-4e88-87bd-154b1b9a793e", status: 204, headers: {"x-request-id": "a462503c-1377-49f6-b40f-74d42e22865c", "date": "Fri, 20 Dec 2024 22:38:35 GMT"} }) saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update
84012024-12-20T22:38:35.305ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = a0c68cf7-84ce-4a59-a3f9-ff7d332963b9 producer_id = b217f28e-649a-4e88-87bd-154b1b9a793e saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update
84022024-12-20T22:38:35.307ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
84032024-12-20T22:38:35.307ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
84042024-12-20T22:38:35.311ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
84052024-12-20T22:38:35.312ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
84062024-12-20T22:38:35.324ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e lock = UpdaterLock { updater_id: f574c260-7098-4029-ac0c-aee79796c9c0, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-12-20T22:38:34.632442651Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update
84072024-12-20T22:38:35.327ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = CommitInstanceUpdates
84082024-12-20T22:38:35.327ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = CommitInstanceUpdates
84092024-12-20T22:38:35.337ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8433 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = dcfa3408-02fc-4a59-8a9e-cf53fe75622a response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
84102024-12-20T22:38:35.412ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e new_runtime = InstanceRuntimeState { time_updated: 2024-12-20T22:38:34.632442651Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update
84112024-12-20T22:38:35.412ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
84122024-12-20T22:38:35.412ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
84132024-12-20T22:38:35.412ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
84142024-12-20T22:38:35.412ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
84152024-12-20T22:38:35.412ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Signaled
84162024-12-20T22:38:35.412ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84172024-12-20T22:38:35.412ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84182024-12-20T22:38:35.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84192024-12-20T22:38:35.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84202024-12-20T22:38:35.415ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84212024-12-20T22:38:35.417ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84222024-12-20T22:38:35.417ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84232024-12-20T22:38:35.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84242024-12-20T22:38:35.418ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84252024-12-20T22:38:35.421ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84262024-12-20T22:38:35.421ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84272024-12-20T22:38:35.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84282024-12-20T22:38:35.451ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
84292024-12-20T22:38:35.451ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
84302024-12-20T22:38:35.467ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
84312024-12-20T22:38:35.467ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("b217f28e-649a-4e88-87bd-154b1b9a793e"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793")}) node_id = 7 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
84322024-12-20T22:38:35.489ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
84332024-12-20T22:38:35.489ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
84342024-12-20T22:38:35.509ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84352024-12-20T22:38:35.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84362024-12-20T22:38:35.511ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
84372024-12-20T22:38:35.511ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
84382024-12-20T22:38:35.518ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84392024-12-20T22:38:35.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84402024-12-20T22:38:35.527ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
84412024-12-20T22:38:35.527ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84422024-12-20T22:38:35.527ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "eeb59fc3-c316-4c4d-8a3c-18b499da6e54", "content-length": "372", "date": "Fri, 20 Dec 2024 22:38:35 GMT"} })
84432024-12-20T22:38:35.527ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84442024-12-20T22:38:35.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84452024-12-20T22:38:35.529ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84462024-12-20T22:38:35.531ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84472024-12-20T22:38:35.531ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84482024-12-20T22:38:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84492024-12-20T22:38:35.533ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84502024-12-20T22:38:35.535ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84512024-12-20T22:38:35.535ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84522024-12-20T22:38:35.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84532024-12-20T22:38:35.543ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
84542024-12-20T22:38:35.543ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
84552024-12-20T22:38:35.557ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e propolis_id = 5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update
84562024-12-20T22:38:35.557ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = ReleaseSledResources
84572024-12-20T22:38:35.557ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = ReleaseSledResources
84582024-12-20T22:38:35.568ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
84592024-12-20T22:38:35.569ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dae42527-7d89-4cc2-87c1-20533dd1278a", "content-length": "691", "date": "Fri, 20 Dec 2024 22:38:35 GMT"} })
84602024-12-20T22:38:35.569ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
84612024-12-20T22:38:35.569ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
84622024-12-20T22:38:35.569ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
84632024-12-20T22:38:35.570ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 157.420923ms iteration = 27 status = {}
84642024-12-20T22:38:35.582ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {14251541-ccc2-46a6-b4c4-eedae5d2650f: {10.151.1.175: {ec773473-5c6d-4c0f-8c23-3b3a1177ca5c}, 10.151.1.176: {ec773473-5c6d-4c0f-8c23-3b3a1177ca5c}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
84652024-12-20T22:38:35.582ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
84662024-12-20T22:38:35.582ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "62475c15-5dad-4d6b-af5c-ffcfde759113", "date": "Fri, 20 Dec 2024 22:38:35 GMT"} })
84672024-12-20T22:38:35.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84682024-12-20T22:38:35.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84692024-12-20T22:38:35.584ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84702024-12-20T22:38:35.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84712024-12-20T22:38:35.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84722024-12-20T22:38:35.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84732024-12-20T22:38:35.591ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
84742024-12-20T22:38:35.591ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84752024-12-20T22:38:35.591ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bdc5d16e-5930-423c-ac8e-367f186862b5", "date": "Fri, 20 Dec 2024 22:38:35 GMT"} })
84762024-12-20T22:38:35.593ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 180.248523ms iteration = 27 status = {}
84772024-12-20T22:38:35.593ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
84782024-12-20T22:38:35.593ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
84792024-12-20T22:38:35.600ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
84802024-12-20T22:38:35.600ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
84812024-12-20T22:38:35.607ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e propolis_id = 5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update
84822024-12-20T22:38:35.607ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = MarkVmmDeleted
84832024-12-20T22:38:35.607ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = MarkVmmDeleted
84842024-12-20T22:38:35.632ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
84852024-12-20T22:38:35.632ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
84862024-12-20T22:38:35.643ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
84872024-12-20T22:38:35.643ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
84882024-12-20T22:38:35.650ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
84892024-12-20T22:38:35.650ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
84902024-12-20T22:38:35.657ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
84912024-12-20T22:38:35.657ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
84922024-12-20T22:38:35.664ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = ChainSuccessorSaga
84932024-12-20T22:38:35.664ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = ChainSuccessorSaga
84942024-12-20T22:38:35.665ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = ChainSuccessorSaga
84952024-12-20T22:38:35.665ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = ChainSuccessorSaga
84962024-12-20T22:38:35.666ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = ChainSuccessorSaga
84972024-12-20T22:38:35.667ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = ChainSuccessorSaga
84982024-12-20T22:38:35.668ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = ChainSuccessorSaga
84992024-12-20T22:38:35.671ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: e1a624a4-dfde-423b-a38d-470dfb011cc3, lookup_type: ById(e1a624a4-dfde-423b-a38d-470dfb011cc3) }, key: 8a281822-6c2e-4e5f-8d97-8acc1d71824b, lookup_type: ById(8a281822-6c2e-4e5f-8d97-8acc1d71824b) }, key: b217f28e-649a-4e88-87bd-154b1b9a793e, lookup_type: ById(b217f28e-649a-4e88-87bd-154b1b9a793e) } result = Ok(()) saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = ChainSuccessorSaga
85002024-12-20T22:38:35.671ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = ChainSuccessorSaga
85012024-12-20T22:38:35.671ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_node = ChainSuccessorSaga
85022024-12-20T22:38:35.677ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e karmic_state = WillReincarnate needs_reincarnation = false saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update
85032024-12-20T22:38:35.677ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
85042024-12-20T22:38:35.677ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
85052024-12-20T22:38:35.689ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
85062024-12-20T22:38:35.689ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
85072024-12-20T22:38:35.694ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
85082024-12-20T22:38:35.694ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
85092024-12-20T22:38:35.703ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
85102024-12-20T22:38:35.703ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73
85112024-12-20T22:38:35.721ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
85122024-12-20T22:38:35.721ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 saga_name = instance-update saga_result = SagaResult { saga_id: 58e84062-2fa7-44a2-9f1c-760c11a70e73, saga_log: SagaLog { saga_id: 58e84062-2fa7-44a2-9f1c-760c11a70e73, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("f574c260-7098-4029-ac0c-aee79796c9c0")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("f574c260-7098-4029-ac0c-aee79796c9c0")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("b217f28e-649a-4e88-87bd-154b1b9a793e"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("b217f28e-649a-4e88-87bd-154b1b9a793e"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("5d30cfc0-e1b9-4f35-8d73-c5e39a7c1793")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("f574c260-7098-4029-ac0c-aee79796c9c0"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("f574c260-7098-4029-ac0c-aee79796c9c0")}} }) }
85132024-12-20T22:38:35.721ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 58e84062-2fa7-44a2-9f1c-760c11a70e73 instance_id = b217f28e-649a-4e88-87bd-154b1b9a793e saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update
85142024-12-20T22:38:35.721ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
85152024-12-20T22:38:35.721ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a
85162024-12-20T22:38:35.743ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
85172024-12-20T22:38:35.743ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a
85182024-12-20T22:38:35.748ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
85192024-12-20T22:38:35.748ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a
85202024-12-20T22:38:35.757ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
85212024-12-20T22:38:35.757ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a
85222024-12-20T22:38:35.812ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update sec_id = c08fb79e-9df2-49bb-be41-3925df103e75
85232024-12-20T22:38:35.812ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 804ebe28-4861-47ee-a841-93ff47f73d2a saga_name = start-instance-update saga_result = SagaResult { saga_id: 804ebe28-4861-47ee-a841-93ff47f73d2a, saga_log: SagaLog { saga_id: 804ebe28-4861-47ee-a841-93ff47f73d2a, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("08942af3-c00b-4a6e-919d-26494f1b524d")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("08942af3-c00b-4a6e-919d-26494f1b524d")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("08942af3-c00b-4a6e-919d-26494f1b524d"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("08942af3-c00b-4a6e-919d-26494f1b524d")}} }) }
85242024-12-20T22:38:35.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5d468431-6dc6-4dc0-9d50-f2abfd518d22 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85252024-12-20T22:38:35.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5d468431-6dc6-4dc0-9d50-f2abfd518d22 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85262024-12-20T22:38:36.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5d468431-6dc6-4dc0-9d50-f2abfd518d22 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85272024-12-20T22:38:36.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = f4b89bc6-d451-4464-9755-775cc8da43a4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
85282024-12-20T22:38:36.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = f4b89bc6-d451-4464-9755-775cc8da43a4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
85292024-12-20T22:38:36.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = f4b89bc6-d451-4464-9755-775cc8da43a4 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
85302024-12-20T22:38:37.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fb44af8f-dfd7-4115-8e2e-77b196b8ca01 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85312024-12-20T22:38:37.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fb44af8f-dfd7-4115-8e2e-77b196b8ca01 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85322024-12-20T22:38:37.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fb44af8f-dfd7-4115-8e2e-77b196b8ca01 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85332024-12-20T22:38:37.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 67a1a85e-0f30-4cf5-806e-d235e59f7926 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
85342024-12-20T22:38:37.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 67a1a85e-0f30-4cf5-806e-d235e59f7926 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
85352024-12-20T22:38:37.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 67a1a85e-0f30-4cf5-806e-d235e59f7926 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
85362024-12-20T22:38:38.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 45f4a883-1080-4291-944a-e6056452ae1c roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85372024-12-20T22:38:38.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 45f4a883-1080-4291-944a-e6056452ae1c resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85382024-12-20T22:38:38.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 45f4a883-1080-4291-944a-e6056452ae1c response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85392024-12-20T22:38:39.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 49abb8fe-e134-48f5-97f7-66e8b0edc31f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85402024-12-20T22:38:39.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 49abb8fe-e134-48f5-97f7-66e8b0edc31f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85412024-12-20T22:38:39.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 49abb8fe-e134-48f5-97f7-66e8b0edc31f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85422024-12-20T22:38:40.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 057b7c08-84de-4c80-95eb-7f20de345515 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85432024-12-20T22:38:40.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 057b7c08-84de-4c80-95eb-7f20de345515 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85442024-12-20T22:38:40.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 057b7c08-84de-4c80-95eb-7f20de345515 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85452024-12-20T22:38:40.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
85462024-12-20T22:38:40.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85472024-12-20T22:38:40.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85482024-12-20T22:38:40.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
85492024-12-20T22:38:40.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85502024-12-20T22:38:40.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85512024-12-20T22:38:40.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85522024-12-20T22:38:40.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85532024-12-20T22:38:40.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85542024-12-20T22:38:40.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85552024-12-20T22:38:40.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85562024-12-20T22:38:40.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85572024-12-20T22:38:40.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85582024-12-20T22:38:40.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
85592024-12-20T22:38:40.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85602024-12-20T22:38:40.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85612024-12-20T22:38:40.600ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
85622024-12-20T22:38:40.600ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.451595ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
85632024-12-20T22:38:40.620ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85642024-12-20T22:38:40.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85652024-12-20T22:38:40.662ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 89.033437ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85662024-12-20T22:38:41.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ee0c5f5e-051b-4e60-90e4-4f5f273e6b88 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85672024-12-20T22:38:41.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ee0c5f5e-051b-4e60-90e4-4f5f273e6b88 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85682024-12-20T22:38:41.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ee0c5f5e-051b-4e60-90e4-4f5f273e6b88 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85692024-12-20T22:38:42.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 00c18c5e-0db1-4462-9c41-4ffd9aeb801e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85702024-12-20T22:38:42.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 00c18c5e-0db1-4462-9c41-4ffd9aeb801e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85712024-12-20T22:38:42.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2859 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 00c18c5e-0db1-4462-9c41-4ffd9aeb801e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85722024-12-20T22:38:43.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9f8d3887-9869-4a90-b683-d8310df60702 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85732024-12-20T22:38:43.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9f8d3887-9869-4a90-b683-d8310df60702 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85742024-12-20T22:38:43.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9f8d3887-9869-4a90-b683-d8310df60702 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85752024-12-20T22:38:44.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 10d1b124-3f3e-469b-a812-f398e1a21e10 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85762024-12-20T22:38:44.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 10d1b124-3f3e-469b-a812-f398e1a21e10 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85772024-12-20T22:38:44.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 10d1b124-3f3e-469b-a812-f398e1a21e10 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85782024-12-20T22:38:45.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 524e9b6e-935a-4be2-943d-99f5a5d3e3c8 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85792024-12-20T22:38:45.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 524e9b6e-935a-4be2-943d-99f5a5d3e3c8 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85802024-12-20T22:38:45.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 524e9b6e-935a-4be2-943d-99f5a5d3e3c8 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85812024-12-20T22:38:45.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 751 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 08cccb9f-402e-4ba6-9677-74d428756bc5 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
85822024-12-20T22:38:46.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ced59761-9c9e-4dcb-b998-a024d3a4faca roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85832024-12-20T22:38:46.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ced59761-9c9e-4dcb-b998-a024d3a4faca resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85842024-12-20T22:38:46.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ced59761-9c9e-4dcb-b998-a024d3a4faca response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85852024-12-20T22:38:47.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 20aaa5bf-cd99-4158-9d08-ee6890866c8c roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85862024-12-20T22:38:47.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 20aaa5bf-cd99-4158-9d08-ee6890866c8c resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85872024-12-20T22:38:47.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2581 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 20aaa5bf-cd99-4158-9d08-ee6890866c8c response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85882024-12-20T22:38:48.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 55802893-3d3d-4adb-ac0c-c4eac312a78e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85892024-12-20T22:38:48.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 55802893-3d3d-4adb-ac0c-c4eac312a78e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85902024-12-20T22:38:48.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 55802893-3d3d-4adb-ac0c-c4eac312a78e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85912024-12-20T22:38:49.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b3315c83-8dea-495d-a22b-f9f0004363ff roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85922024-12-20T22:38:49.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b3315c83-8dea-495d-a22b-f9f0004363ff resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85932024-12-20T22:38:49.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2774 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b3315c83-8dea-495d-a22b-f9f0004363ff response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85942024-12-20T22:38:50.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4ecb7eb8-274a-41dd-b212-618c7de7d2e2 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85952024-12-20T22:38:50.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4ecb7eb8-274a-41dd-b212-618c7de7d2e2 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85962024-12-20T22:38:50.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4ecb7eb8-274a-41dd-b212-618c7de7d2e2 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
85972024-12-20T22:38:50.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 4a316c15-05a3-4436-be03-642033b92ba5 roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
85982024-12-20T22:38:50.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 4a316c15-05a3-4436-be03-642033b92ba5 resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
85992024-12-20T22:38:50.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2661 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = 4a316c15-05a3-4436-be03-642033b92ba5 response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?sort_by=id_ascending
86002024-12-20T22:38:50.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = b051b8ac-aec8-4d0a-aad9-cd5554080d71 roles = RoleSet { roles: {} } uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
86012024-12-20T22:38:50.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = b051b8ac-aec8-4d0a-aad9-cd5554080d71 resource = Database result = Ok(()) uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
86022024-12-20T22:38:50.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2643 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64780 req_id = b051b8ac-aec8-4d0a-aad9-cd5554080d71 response_code = 200 uri = /metrics/collectors/a0c68cf7-84ce-4a59-a3f9-ff7d332963b9/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJkNTNlOTczZS03M2ZjLTQxMTctYTlmNy00NzMwNWJlN2U3NGMifX0%3D
86032024-12-20T22:38:50.571ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
86042024-12-20T22:38:50.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86052024-12-20T22:38:50.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86062024-12-20T22:38:50.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
86072024-12-20T22:38:50.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86082024-12-20T22:38:50.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86092024-12-20T22:38:50.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86102024-12-20T22:38:50.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86112024-12-20T22:38:50.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86122024-12-20T22:38:50.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86132024-12-20T22:38:50.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86142024-12-20T22:38:50.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86152024-12-20T22:38:50.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86162024-12-20T22:38:50.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
86172024-12-20T22:38:50.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86182024-12-20T22:38:50.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86192024-12-20T22:38:50.592ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
86202024-12-20T22:38:50.592ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.988219ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
86212024-12-20T22:38:50.610ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86222024-12-20T22:38:50.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86232024-12-20T22:38:50.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.440459ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86242024-12-20T22:38:51.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9311467f-cd18-4b98-8e84-db10b5e98381 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86252024-12-20T22:38:51.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9311467f-cd18-4b98-8e84-db10b5e98381 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86262024-12-20T22:38:51.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9311467f-cd18-4b98-8e84-db10b5e98381 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86272024-12-20T22:38:52.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f9967209-3c67-40c8-9338-ba8e5d3d8df0 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86282024-12-20T22:38:52.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f9967209-3c67-40c8-9338-ba8e5d3d8df0 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86292024-12-20T22:38:52.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f9967209-3c67-40c8-9338-ba8e5d3d8df0 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86302024-12-20T22:38:53.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9edad862-83dc-44c8-9eba-d66d9b1e9122 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86312024-12-20T22:38:53.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9edad862-83dc-44c8-9eba-d66d9b1e9122 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86322024-12-20T22:38:53.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1854 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9edad862-83dc-44c8-9eba-d66d9b1e9122 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86332024-12-20T22:38:54.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b7cedd8e-00f8-4b6a-b539-a2c9cc914380 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86342024-12-20T22:38:54.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b7cedd8e-00f8-4b6a-b539-a2c9cc914380 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86352024-12-20T22:38:54.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2613 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b7cedd8e-00f8-4b6a-b539-a2c9cc914380 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86362024-12-20T22:38:55.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 617 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 202e2fe6-faa8-42a1-ad55-4a1c5837eb9c response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
86372024-12-20T22:38:55.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5aeda11c-c955-4ed2-89ec-620a08091d7e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86382024-12-20T22:38:55.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5aeda11c-c955-4ed2-89ec-620a08091d7e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86392024-12-20T22:38:55.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5aeda11c-c955-4ed2-89ec-620a08091d7e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86402024-12-20T22:38:56.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6e324da8-0745-4e11-8063-7535caa48b4e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86412024-12-20T22:38:56.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6e324da8-0745-4e11-8063-7535caa48b4e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86422024-12-20T22:38:56.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6e324da8-0745-4e11-8063-7535caa48b4e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86432024-12-20T22:38:57.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9dcd1170-d6ce-4161-87f6-9505cc36e04a roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86442024-12-20T22:38:57.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9dcd1170-d6ce-4161-87f6-9505cc36e04a resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86452024-12-20T22:38:57.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9dcd1170-d6ce-4161-87f6-9505cc36e04a response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86462024-12-20T22:38:58.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6131edad-d70b-408f-8636-719ba0e2f94b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86472024-12-20T22:38:58.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6131edad-d70b-408f-8636-719ba0e2f94b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86482024-12-20T22:38:58.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6131edad-d70b-408f-8636-719ba0e2f94b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86492024-12-20T22:38:59.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ed7319be-cf88-408d-bec2-8e78d43ba2c8 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86502024-12-20T22:38:59.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ed7319be-cf88-408d-bec2-8e78d43ba2c8 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86512024-12-20T22:38:59.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ed7319be-cf88-408d-bec2-8e78d43ba2c8 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86522024-12-20T22:39:00.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0be0b6e6-abe2-46cf-8bd3-1d0e9372c465 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86532024-12-20T22:39:00.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0be0b6e6-abe2-46cf-8bd3-1d0e9372c465 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86542024-12-20T22:39:00.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0be0b6e6-abe2-46cf-8bd3-1d0e9372c465 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
86552024-12-20T22:39:00.571ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
86562024-12-20T22:39:00.571ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
86572024-12-20T22:39:00.571ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86582024-12-20T22:39:00.571ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
86592024-12-20T22:39:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
86602024-12-20T22:39:00.571ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
86612024-12-20T22:39:00.571ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:29:00.571871495 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
86622024-12-20T22:39:00.571ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
86632024-12-20T22:39:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
86642024-12-20T22:39:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
86652024-12-20T22:39:00.571ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
86662024-12-20T22:39:00.571ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
86672024-12-20T22:39:00.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86682024-12-20T22:39:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
86692024-12-20T22:39:00.571ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86702024-12-20T22:39:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
86712024-12-20T22:39:00.572ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
86722024-12-20T22:39:00.572ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
86732024-12-20T22:39:00.572ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
86742024-12-20T22:39:00.572ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86752024-12-20T22:39:00.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
86762024-12-20T22:39:00.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
86772024-12-20T22:39:00.572ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e
86782024-12-20T22:39:00.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86792024-12-20T22:39:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.1\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e"}
86802024-12-20T22:39:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
86812024-12-20T22:39:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86822024-12-20T22:39:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
86832024-12-20T22:39:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86842024-12-20T22:39:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86852024-12-20T22:39:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86862024-12-20T22:39:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86872024-12-20T22:39:00.572ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b172144-6fe3-403a-b88e-6be93db6788c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e1e925bb-4266-49d2-b532-0f79860badbb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9d7e78a-d944-4f23-9be0-86e0f1334a43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9d7e78a-d944-4f23-9be0-86e0f1334a43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1488, tv_nsec: 184892574 } })
86882024-12-20T22:39:00.572ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bcf7579-f08c-458a-b8fa-486beafab77e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c65750e1-e505-4d05-b242-145c69974016.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c65750e1-e505-4d05-b242-145c69974016.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1488, tv_nsec: 184892665 } })
86892024-12-20T22:39:00.572ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
86902024-12-20T22:39:00.572ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
86912024-12-20T22:39:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.067109ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
86922024-12-20T22:39:00.572ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86932024-12-20T22:39:00.572ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
86942024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
86952024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
86962024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86972024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86982024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
86992024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87002024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
87012024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87022024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
87032024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
87042024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
87052024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87062024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
87072024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87082024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
87092024-12-20T22:39:00.573ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
87102024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
87112024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
87122024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87132024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
87142024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
87152024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
87162024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87172024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
87182024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
87192024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
87202024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87212024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
87222024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
87232024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
87242024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
87252024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
87262024-12-20T22:39:00.573ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
87272024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87282024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
87292024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.287336ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
87302024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87312024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87322024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87332024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87342024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87352024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87362024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
87372024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87382024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
87392024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
87402024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87412024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87422024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
87432024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
87442024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
87452024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
87462024-12-20T22:39:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87472024-12-20T22:39:00.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87482024-12-20T22:39:00.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87492024-12-20T22:39:00.575ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1488, tv_nsec: 188086963 } })
87502024-12-20T22:39:00.575ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1488, tv_nsec: 188238577 } })
87512024-12-20T22:39:00.575ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
87522024-12-20T22:39:00.576ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
87532024-12-20T22:39:00.576ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.548806ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
87542024-12-20T22:39:00.576ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87552024-12-20T22:39:00.576ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:29:00.571871495 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
87562024-12-20T22:39:00.576ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.933116ms iteration = 14 status = {"expiration":"2024-12-20T22:29:00.571871495Z","pruned":[]}
87572024-12-20T22:39:00.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87582024-12-20T22:39:00.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87592024-12-20T22:39:00.578ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87602024-12-20T22:39:00.578ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87612024-12-20T22:39:00.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87622024-12-20T22:39:00.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87632024-12-20T22:39:00.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87642024-12-20T22:39:00.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
87652024-12-20T22:39:00.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87662024-12-20T22:39:00.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87672024-12-20T22:39:00.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
87682024-12-20T22:39:00.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87692024-12-20T22:39:00.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87702024-12-20T22:39:00.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87712024-12-20T22:39:00.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87722024-12-20T22:39:00.584ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87732024-12-20T22:39:00.585ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87742024-12-20T22:39:00.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
87752024-12-20T22:39:00.587ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
87762024-12-20T22:39:00.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
87772024-12-20T22:39:00.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
87782024-12-20T22:39:00.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87792024-12-20T22:39:00.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87802024-12-20T22:39:00.590ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87812024-12-20T22:39:00.590ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.517073ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
87822024-12-20T22:39:00.590ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87832024-12-20T22:39:00.592ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
87842024-12-20T22:39:00.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87852024-12-20T22:39:00.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87862024-12-20T22:39:00.594ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87872024-12-20T22:39:00.594ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87882024-12-20T22:39:00.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87892024-12-20T22:39:00.595ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87902024-12-20T22:39:00.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
87912024-12-20T22:39:00.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87922024-12-20T22:39:00.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
87932024-12-20T22:39:00.598ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87942024-12-20T22:39:00.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87952024-12-20T22:39:00.599ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1488, tv_nsec: 212391604 } })
87962024-12-20T22:39:00.600ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.230552ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87972024-12-20T22:39:00.600ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
87982024-12-20T22:39:00.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87992024-12-20T22:39:00.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88002024-12-20T22:39:00.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88012024-12-20T22:39:00.602ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88022024-12-20T22:39:00.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88032024-12-20T22:39:00.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88042024-12-20T22:39:00.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88052024-12-20T22:39:00.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
88062024-12-20T22:39:00.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88072024-12-20T22:39:00.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88082024-12-20T22:39:00.626ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
88092024-12-20T22:39:00.627ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.947246ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
88102024-12-20T22:39:00.634ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88112024-12-20T22:39:00.634ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
88122024-12-20T22:39:00.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88132024-12-20T22:39:00.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88142024-12-20T22:39:00.637ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88152024-12-20T22:39:00.637ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
88162024-12-20T22:39:00.637ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88172024-12-20T22:39:00.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88182024-12-20T22:39:00.638ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88192024-12-20T22:39:00.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88202024-12-20T22:39:00.639ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88212024-12-20T22:39:00.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88222024-12-20T22:39:00.640ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88232024-12-20T22:39:00.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88242024-12-20T22:39:00.652ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 79.71107ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
88252024-12-20T22:39:00.653ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88262024-12-20T22:39:00.656ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
88272024-12-20T22:39:00.657ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88282024-12-20T22:39:00.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88292024-12-20T22:39:00.661ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88302024-12-20T22:39:00.661ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88312024-12-20T22:39:00.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88322024-12-20T22:39:00.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
88332024-12-20T22:39:00.663ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88342024-12-20T22:39:00.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88352024-12-20T22:39:00.667ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
88362024-12-20T22:39:00.667ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
88372024-12-20T22:39:00.667ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
88382024-12-20T22:39:00.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88392024-12-20T22:39:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88402024-12-20T22:39:00.668ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
88412024-12-20T22:39:00.668ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
88422024-12-20T22:39:00.668ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
88432024-12-20T22:39:00.668ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88442024-12-20T22:39:00.668ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88452024-12-20T22:39:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88462024-12-20T22:39:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88472024-12-20T22:39:00.669ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88482024-12-20T22:39:00.669ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88492024-12-20T22:39:00.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88502024-12-20T22:39:00.670ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
88512024-12-20T22:39:00.670ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
88522024-12-20T22:39:00.670ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 97.222163ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
88532024-12-20T22:39:00.671ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88542024-12-20T22:39:00.673ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 99.886196ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
88552024-12-20T22:39:00.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
88562024-12-20T22:39:00.673ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88572024-12-20T22:39:00.673ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88582024-12-20T22:39:00.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88592024-12-20T22:39:00.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88602024-12-20T22:39:00.674ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
88612024-12-20T22:39:00.674ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 101.195123ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
88622024-12-20T22:39:00.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
88632024-12-20T22:39:00.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88642024-12-20T22:39:00.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88652024-12-20T22:39:00.675ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88662024-12-20T22:39:00.675ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88672024-12-20T22:39:00.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88682024-12-20T22:39:00.675ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88692024-12-20T22:39:00.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88702024-12-20T22:39:00.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88712024-12-20T22:39:00.676ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88722024-12-20T22:39:00.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88732024-12-20T22:39:00.680ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
88742024-12-20T22:39:00.680ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
88752024-12-20T22:39:00.680ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 107.909458ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
88762024-12-20T22:39:00.695ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 122.358656ms iteration = 30 status = {"physical_disks_added":0}
88772024-12-20T22:39:00.708ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88782024-12-20T22:39:00.708ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
88792024-12-20T22:39:00.708ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 135.365206ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
88802024-12-20T22:39:00.710ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88812024-12-20T22:39:00.713ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88822024-12-20T22:39:00.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88832024-12-20T22:39:00.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
88842024-12-20T22:39:00.715ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88852024-12-20T22:39:00.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88862024-12-20T22:39:00.716ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 143.736287ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
88872024-12-20T22:39:00.717ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
88882024-12-20T22:39:00.717ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88892024-12-20T22:39:00.717ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c99f08f0-7370-455a-818e-c638f9414743", "content-length": "26", "date": "Fri, 20 Dec 2024 22:39:00 GMT"} })
88902024-12-20T22:39:00.717ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88912024-12-20T22:39:00.719ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
88922024-12-20T22:39:00.726ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
88932024-12-20T22:39:00.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
88942024-12-20T22:39:00.729ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
88952024-12-20T22:39:00.729ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
88962024-12-20T22:39:00.729ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88972024-12-20T22:39:00.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88982024-12-20T22:39:00.734ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
88992024-12-20T22:39:00.734ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 0 version = 2
89002024-12-20T22:39:00.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89012024-12-20T22:39:00.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89022024-12-20T22:39:00.739ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
89032024-12-20T22:39:00.744ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 171.271196ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
89042024-12-20T22:39:00.749ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89052024-12-20T22:39:00.751ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
89062024-12-20T22:39:00.751ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89072024-12-20T22:39:00.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89082024-12-20T22:39:00.769ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 zone_address = fd00:1122:3344:101::2
89092024-12-20T22:39:00.769ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89102024-12-20T22:39:00.770ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4bf378a-eb15-4991-8479-1d4486e7b393", "content-length": "26", "date": "Fri, 20 Dec 2024 22:39:00 GMT"} })
89112024-12-20T22:39:00.770ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89122024-12-20T22:39:00.772ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
89132024-12-20T22:39:00.775ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89142024-12-20T22:39:00.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89152024-12-20T22:39:00.818ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
89162024-12-20T22:39:00.818ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89172024-12-20T22:39:00.818ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b59a0403-a6ad-4eed-97f5-6315912858f2", "content-length": "26", "date": "Fri, 20 Dec 2024 22:39:00 GMT"} })
89182024-12-20T22:39:00.818ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89192024-12-20T22:39:00.820ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89202024-12-20T22:39:00.847ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
89212024-12-20T22:39:00.870ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 298.639192ms iteration = 27 status = {}
89222024-12-20T22:39:00.871ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
89232024-12-20T22:39:00.871ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89242024-12-20T22:39:00.871ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "72755bfc-d493-41f9-a6c7-1ffcda616301", "content-length": "372", "date": "Fri, 20 Dec 2024 22:38:59 GMT"} })
89252024-12-20T22:39:00.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89262024-12-20T22:39:00.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89272024-12-20T22:39:00.874ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 301.11948ms iteration = 27 status = 0
89282024-12-20T22:39:00.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89292024-12-20T22:39:00.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89302024-12-20T22:39:00.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
89312024-12-20T22:39:00.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89322024-12-20T22:39:00.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89332024-12-20T22:39:00.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89342024-12-20T22:39:00.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89352024-12-20T22:39:00.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89362024-12-20T22:39:00.881ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 1 version = 2
89372024-12-20T22:39:00.881ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
89382024-12-20T22:39:00.881ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:26:40.428768 UTC dns_group = external generation = 2
89392024-12-20T22:39:00.881ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 309.613174ms iteration = 14 status = {"generation":2}
89402024-12-20T22:39:00.881ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
89412024-12-20T22:39:00.881ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
89422024-12-20T22:39:00.881ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:26:39.700273 UTC dns_group = internal generation = 1
89432024-12-20T22:39:00.881ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 309.81678ms iteration = 14 status = {"generation":1}
89442024-12-20T22:39:00.890ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
89452024-12-20T22:39:00.890ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d8ca594b-0267-4a35-bd38-765603461ccd", "date": "Fri, 20 Dec 2024 22:39:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89462024-12-20T22:39:00.890ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89472024-12-20T22:39:00.893ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "51514783-dafc-43d2-9e40-5601ed1aacc6", "date": "Fri, 20 Dec 2024 22:39:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89482024-12-20T22:39:00.893ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89492024-12-20T22:39:00.894ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
89502024-12-20T22:39:00.894ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 322.530931ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
89512024-12-20T22:39:00.916ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
89522024-12-20T22:39:00.916ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f64a2664-5e27-4758-8c81-9e16afd284e8", "content-length": "2", "date": "Fri, 20 Dec 2024 22:39:00 GMT"} })
89532024-12-20T22:39:00.919ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89542024-12-20T22:39:00.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89552024-12-20T22:39:00.922ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 350.490922ms iteration = 27 status = null
89562024-12-20T22:39:00.926ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 353.609628ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
89572024-12-20T22:39:00.928ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89582024-12-20T22:39:00.929ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
89592024-12-20T22:39:00.930ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89602024-12-20T22:39:00.930ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89612024-12-20T22:39:00.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89622024-12-20T22:39:00.932ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89632024-12-20T22:39:00.935ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89642024-12-20T22:39:00.935ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89652024-12-20T22:39:00.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89662024-12-20T22:39:00.938ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
89672024-12-20T22:39:00.938ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
89682024-12-20T22:39:00.939ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "212b8afa-c559-4ebb-9c0b-3b47b9f10d3f", "date": "Fri, 20 Dec 2024 22:38:59 GMT"} })
89692024-12-20T22:39:00.939ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89702024-12-20T22:39:00.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89712024-12-20T22:39:00.940ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89722024-12-20T22:39:00.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89732024-12-20T22:39:00.941ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:25:57.040586Z, time_modified: 2024-12-20T22:25:57.040586Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
89742024-12-20T22:39:00.941ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 369.193108ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]}},"default_endpoint":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
89752024-12-20T22:39:00.943ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89762024-12-20T22:39:00.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89772024-12-20T22:39:00.946ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
89782024-12-20T22:39:00.946ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89792024-12-20T22:39:00.947ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "48d4699e-16b2-40a4-880e-d708270eaefe", "date": "Fri, 20 Dec 2024 22:38:59 GMT"} })
89802024-12-20T22:39:00.948ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 375.842922ms iteration = 28 status = {}
89812024-12-20T22:39:00.968ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
89822024-12-20T22:39:00.969ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a5ecbdb7-acc3-43fd-ad03-b24fa11afed9", "date": "Fri, 20 Dec 2024 22:39:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89832024-12-20T22:39:00.969ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89842024-12-20T22:39:00.970ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e6cfde75-259e-4c6a-af98-8e2fc27f0053", "date": "Fri, 20 Dec 2024 22:39:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89852024-12-20T22:39:00.970ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89862024-12-20T22:39:00.973ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "3838c1a1-91df-4185-9ef1-b6a30ff65a0d", "date": "Fri, 20 Dec 2024 22:39:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89872024-12-20T22:39:00.973ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89882024-12-20T22:39:00.975ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
89892024-12-20T22:39:00.975ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 404.012589ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
89902024-12-20T22:39:00.989ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89912024-12-20T22:39:00.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89922024-12-20T22:39:00.991ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9fedf0d4-8a86-4506-bf93-224faabd5e37, rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b26f0563-25fb-4d7c-8480-dd368ac01105) } rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
89932024-12-20T22:39:00.991ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89942024-12-20T22:39:00.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89952024-12-20T22:39:01.002ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
89962024-12-20T22:39:01.003ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c6f0ff8-0f18-4096-b10c-7b9edc4ffee5", "content-length": "134", "date": "Fri, 20 Dec 2024 22:39:00 GMT"} })
89972024-12-20T22:39:01.003ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
89982024-12-20T22:39:01.003ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b26f0563-25fb-4d7c-8480-dd368ac01105
89992024-12-20T22:39:01.003ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
90002024-12-20T22:39:01.003ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
90012024-12-20T22:39:01.003ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90022024-12-20T22:39:01.003ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90032024-12-20T22:39:01.003ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90042024-12-20T22:39:01.003ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90052024-12-20T22:39:01.003ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90062024-12-20T22:39:01.003ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90072024-12-20T22:39:01.003ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
90082024-12-20T22:39:01.003ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90092024-12-20T22:39:01.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90102024-12-20T22:39:01.006ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
90112024-12-20T22:39:01.006ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2223b128-0c18-402c-aa04-39dbdd11b5f8", "content-length": "2", "date": "Fri, 20 Dec 2024 22:39:00 GMT"} })
90122024-12-20T22:39:01.006ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
90132024-12-20T22:39:01.006ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d3b41f5-3006-4fb4-bb68-006eadb110f6", "content-length": "52", "date": "Fri, 20 Dec 2024 22:39:00 GMT"} })
90142024-12-20T22:39:01.006ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
90152024-12-20T22:39:01.006ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
90162024-12-20T22:39:01.011ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
90172024-12-20T22:39:01.011ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 438.000267ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
90182024-12-20T22:39:01.046ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
90192024-12-20T22:39:01.100ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e8eab9d9-48fe-4438-88ea-6a138edb143e", "date": "Fri, 20 Dec 2024 22:39:01 GMT"} })
90202024-12-20T22:39:01.100ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch = Switch0
90212024-12-20T22:39:01.100ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
90222024-12-20T22:39:01.100ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6974e24-f654-4186-8752-7dd01bf124b0", "content-length": "691", "date": "Fri, 20 Dec 2024 22:39:01 GMT"} })
90232024-12-20T22:39:01.100ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
90242024-12-20T22:39:01.100ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
90252024-12-20T22:39:01.101ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
90262024-12-20T22:39:01.101ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c26e05b3-02d5-4477-9ca1-621a553c10f1", "content-length": "682", "date": "Fri, 20 Dec 2024 22:39:01 GMT"} })
90272024-12-20T22:39:01.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90282024-12-20T22:39:01.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90292024-12-20T22:39:01.101ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 528.930506ms iteration = 28 status = {}
90302024-12-20T22:39:01.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90312024-12-20T22:39:01.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90322024-12-20T22:39:01.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90332024-12-20T22:39:01.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90342024-12-20T22:39:01.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90352024-12-20T22:39:01.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90362024-12-20T22:39:01.118ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 545.684369ms iteration = 27 status = {}
90372024-12-20T22:39:01.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 723cbd34-2834-44c6-bf3c-a17d56e29148 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90382024-12-20T22:39:01.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 723cbd34-2834-44c6-bf3c-a17d56e29148 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90392024-12-20T22:39:01.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 723cbd34-2834-44c6-bf3c-a17d56e29148 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90402024-12-20T22:39:02.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2f3681f9-679a-49dc-a858-6daecde70bce roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90412024-12-20T22:39:02.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2f3681f9-679a-49dc-a858-6daecde70bce resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90422024-12-20T22:39:02.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2564 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2f3681f9-679a-49dc-a858-6daecde70bce response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90432024-12-20T22:39:03.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fb72de24-6a92-4d9f-9596-c23484a91cb8 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90442024-12-20T22:39:03.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fb72de24-6a92-4d9f-9596-c23484a91cb8 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90452024-12-20T22:39:03.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2641 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fb72de24-6a92-4d9f-9596-c23484a91cb8 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90462024-12-20T22:39:04.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 07ff1c31-a537-420a-84be-ecc29e6efbbb roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90472024-12-20T22:39:04.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 07ff1c31-a537-420a-84be-ecc29e6efbbb resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90482024-12-20T22:39:04.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2771 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 07ff1c31-a537-420a-84be-ecc29e6efbbb response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90492024-12-20T22:39:05.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 601 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 459728ca-0cf1-4483-a7c8-aa3dd04d6d8d response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
90502024-12-20T22:39:05.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3b154894-a9ff-4591-b113-74fa7d0f81b7 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90512024-12-20T22:39:05.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3b154894-a9ff-4591-b113-74fa7d0f81b7 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90522024-12-20T22:39:05.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3b154894-a9ff-4591-b113-74fa7d0f81b7 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90532024-12-20T22:39:06.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 000c2971-3708-4ee4-bd92-ae334a16a194 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90542024-12-20T22:39:06.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 000c2971-3708-4ee4-bd92-ae334a16a194 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90552024-12-20T22:39:06.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 000c2971-3708-4ee4-bd92-ae334a16a194 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90562024-12-20T22:39:07.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 0ff14683-8fbe-4a64-a670-d5dcd38bd965 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
90572024-12-20T22:39:07.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 0ff14683-8fbe-4a64-a670-d5dcd38bd965 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
90582024-12-20T22:39:07.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 0ff14683-8fbe-4a64-a670-d5dcd38bd965 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
90592024-12-20T22:39:07.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 820986b6-2c87-4a4b-be48-e745832c7d2e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90602024-12-20T22:39:07.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 820986b6-2c87-4a4b-be48-e745832c7d2e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90612024-12-20T22:39:07.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 820986b6-2c87-4a4b-be48-e745832c7d2e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90622024-12-20T22:39:08.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 93596fd0-72d6-413d-bfc2-c5f0f420b351 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90632024-12-20T22:39:08.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 93596fd0-72d6-413d-bfc2-c5f0f420b351 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90642024-12-20T22:39:08.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 93596fd0-72d6-413d-bfc2-c5f0f420b351 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90652024-12-20T22:39:09.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 230067c3-3f43-4b28-b747-78f22b0fca4a roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90662024-12-20T22:39:09.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 230067c3-3f43-4b28-b747-78f22b0fca4a resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90672024-12-20T22:39:09.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 230067c3-3f43-4b28-b747-78f22b0fca4a response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90682024-12-20T22:39:10.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
90692024-12-20T22:39:10.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90702024-12-20T22:39:10.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90712024-12-20T22:39:10.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
90722024-12-20T22:39:10.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90732024-12-20T22:39:10.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90742024-12-20T22:39:10.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90752024-12-20T22:39:10.616ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90762024-12-20T22:39:10.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90772024-12-20T22:39:10.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90782024-12-20T22:39:10.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90792024-12-20T22:39:10.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90802024-12-20T22:39:10.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90812024-12-20T22:39:10.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90822024-12-20T22:39:10.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90832024-12-20T22:39:10.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
90842024-12-20T22:39:10.625ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90852024-12-20T22:39:10.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90862024-12-20T22:39:10.637ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
90872024-12-20T22:39:10.637ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 65.23292ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
90882024-12-20T22:39:10.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 86.523498ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90892024-12-20T22:39:10.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 805a0bb2-b869-43ca-900a-ee791074d136 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90902024-12-20T22:39:10.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 805a0bb2-b869-43ca-900a-ee791074d136 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90912024-12-20T22:39:10.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2078 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 805a0bb2-b869-43ca-900a-ee791074d136 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90922024-12-20T22:39:11.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4d7b384a-219f-4c21-adf4-d2b70ba2e411 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90932024-12-20T22:39:11.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4d7b384a-219f-4c21-adf4-d2b70ba2e411 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90942024-12-20T22:39:11.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4d7b384a-219f-4c21-adf4-d2b70ba2e411 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90952024-12-20T22:39:12.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 629a61fa-0ed8-4193-a94c-8ff8d1fe0a4b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90962024-12-20T22:39:12.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 629a61fa-0ed8-4193-a94c-8ff8d1fe0a4b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90972024-12-20T22:39:12.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1966 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 629a61fa-0ed8-4193-a94c-8ff8d1fe0a4b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90982024-12-20T22:39:13.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a52f3db7-a6cd-4db0-91c4-4661a33dd913 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
90992024-12-20T22:39:13.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a52f3db7-a6cd-4db0-91c4-4661a33dd913 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91002024-12-20T22:39:13.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a52f3db7-a6cd-4db0-91c4-4661a33dd913 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91012024-12-20T22:39:14.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ba7af239-b85c-4475-a7d0-58c6d0ce058d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91022024-12-20T22:39:14.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ba7af239-b85c-4475-a7d0-58c6d0ce058d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91032024-12-20T22:39:14.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ba7af239-b85c-4475-a7d0-58c6d0ce058d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91042024-12-20T22:39:15.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 593 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = bcd2617d-afa0-4257-911a-17c853561472 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
91052024-12-20T22:39:15.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ac1968a0-6d13-4e78-8724-5308b406824a roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91062024-12-20T22:39:15.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ac1968a0-6d13-4e78-8724-5308b406824a resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91072024-12-20T22:39:15.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ac1968a0-6d13-4e78-8724-5308b406824a response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91082024-12-20T22:39:16.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e11b1c79-ea31-44f4-a481-ee2900cdc5ab roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91092024-12-20T22:39:16.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e11b1c79-ea31-44f4-a481-ee2900cdc5ab resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91102024-12-20T22:39:16.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e11b1c79-ea31-44f4-a481-ee2900cdc5ab response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91112024-12-20T22:39:17.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0e97cc6e-83dd-4504-a98c-6a9cd4764831 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91122024-12-20T22:39:17.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0e97cc6e-83dd-4504-a98c-6a9cd4764831 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91132024-12-20T22:39:17.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2041 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0e97cc6e-83dd-4504-a98c-6a9cd4764831 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91142024-12-20T22:39:18.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 74cca1bd-e2d5-4f61-b9eb-e0a777223a48 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91152024-12-20T22:39:18.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 74cca1bd-e2d5-4f61-b9eb-e0a777223a48 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91162024-12-20T22:39:18.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 74cca1bd-e2d5-4f61-b9eb-e0a777223a48 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91172024-12-20T22:39:19.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ff4c4a9d-54b3-4eab-96ee-c799b5d7572b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91182024-12-20T22:39:19.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ff4c4a9d-54b3-4eab-96ee-c799b5d7572b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91192024-12-20T22:39:19.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ff4c4a9d-54b3-4eab-96ee-c799b5d7572b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91202024-12-20T22:39:20.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
91212024-12-20T22:39:20.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91222024-12-20T22:39:20.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91232024-12-20T22:39:20.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
91242024-12-20T22:39:20.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91252024-12-20T22:39:20.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91262024-12-20T22:39:20.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91272024-12-20T22:39:20.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91282024-12-20T22:39:20.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91292024-12-20T22:39:20.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91302024-12-20T22:39:20.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91312024-12-20T22:39:20.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91322024-12-20T22:39:20.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91332024-12-20T22:39:20.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91342024-12-20T22:39:20.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91352024-12-20T22:39:20.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
91362024-12-20T22:39:20.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91372024-12-20T22:39:20.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91382024-12-20T22:39:20.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
91392024-12-20T22:39:20.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.135937ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
91402024-12-20T22:39:20.616ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.702586ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91412024-12-20T22:39:20.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 24feb611-f0df-4c81-a07b-aac72a1b6b07 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91422024-12-20T22:39:20.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 24feb611-f0df-4c81-a07b-aac72a1b6b07 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91432024-12-20T22:39:20.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 24feb611-f0df-4c81-a07b-aac72a1b6b07 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91442024-12-20T22:39:21.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 93be851f-50e8-4362-9fb8-2f4631ac56ce roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91452024-12-20T22:39:21.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 93be851f-50e8-4362-9fb8-2f4631ac56ce resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91462024-12-20T22:39:21.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 93be851f-50e8-4362-9fb8-2f4631ac56ce response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91472024-12-20T22:39:23.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0841ab36-57d7-4307-87c1-e38acf4aad2d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91482024-12-20T22:39:23.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0841ab36-57d7-4307-87c1-e38acf4aad2d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91492024-12-20T22:39:23.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0841ab36-57d7-4307-87c1-e38acf4aad2d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91502024-12-20T22:39:24.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 73dae44c-a28a-414f-bb9a-243f6ddc11e8 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91512024-12-20T22:39:24.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 73dae44c-a28a-414f-bb9a-243f6ddc11e8 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91522024-12-20T22:39:24.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 73dae44c-a28a-414f-bb9a-243f6ddc11e8 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91532024-12-20T22:39:25.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6cd97da6-e861-4cd7-bf29-29ad7a309954 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91542024-12-20T22:39:25.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6cd97da6-e861-4cd7-bf29-29ad7a309954 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91552024-12-20T22:39:25.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6cd97da6-e861-4cd7-bf29-29ad7a309954 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91562024-12-20T22:39:25.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 848 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 47bf7e44-0d91-4200-843e-e0674e1b1ab7 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
91572024-12-20T22:39:26.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4b9c7170-6c1a-4950-b95f-417b0d9e373e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91582024-12-20T22:39:26.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4b9c7170-6c1a-4950-b95f-417b0d9e373e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91592024-12-20T22:39:26.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4b9c7170-6c1a-4950-b95f-417b0d9e373e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91602024-12-20T22:39:27.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0ac8e947-7989-41a0-8c60-775b39a9292e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91612024-12-20T22:39:27.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0ac8e947-7989-41a0-8c60-775b39a9292e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91622024-12-20T22:39:27.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0ac8e947-7989-41a0-8c60-775b39a9292e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91632024-12-20T22:39:28.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3b57c04c-b827-4682-a7da-8756487cc86a roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91642024-12-20T22:39:28.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3b57c04c-b827-4682-a7da-8756487cc86a resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91652024-12-20T22:39:28.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 3b57c04c-b827-4682-a7da-8756487cc86a response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91662024-12-20T22:39:29.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = bd53d829-3f1b-4dd3-a2e5-f962baba2f5e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91672024-12-20T22:39:29.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = bd53d829-3f1b-4dd3-a2e5-f962baba2f5e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91682024-12-20T22:39:29.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = bd53d829-3f1b-4dd3-a2e5-f962baba2f5e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91692024-12-20T22:39:30.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 32134fd4-d16c-429b-b12b-3a7d2158c256 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91702024-12-20T22:39:30.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 32134fd4-d16c-429b-b12b-3a7d2158c256 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91712024-12-20T22:39:30.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 32134fd4-d16c-429b-b12b-3a7d2158c256 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
91722024-12-20T22:39:30.571ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
91732024-12-20T22:39:30.571ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
91742024-12-20T22:39:30.571ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
91752024-12-20T22:39:30.571ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
91762024-12-20T22:39:30.571ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
91772024-12-20T22:39:30.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
91782024-12-20T22:39:30.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
91792024-12-20T22:39:30.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
91802024-12-20T22:39:30.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91812024-12-20T22:39:30.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91822024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
91832024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
91842024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
91852024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91862024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
91872024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
91882024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
91892024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91902024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
91912024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
91922024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
91932024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
91942024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
91952024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
91962024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
91972024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
91982024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91992024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
92002024-12-20T22:39:30.573ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
92012024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
92022024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92032024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92042024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
92052024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
92062024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92072024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92082024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
92092024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92102024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92112024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92122024-12-20T22:39:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92132024-12-20T22:39:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92142024-12-20T22:39:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
92152024-12-20T22:39:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92162024-12-20T22:39:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92172024-12-20T22:39:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92182024-12-20T22:39:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92192024-12-20T22:39:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
92202024-12-20T22:39:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92212024-12-20T22:39:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92222024-12-20T22:39:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92232024-12-20T22:39:30.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1518, tv_nsec: 187020023 } })
92242024-12-20T22:39:30.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
92252024-12-20T22:39:30.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92262024-12-20T22:39:30.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92272024-12-20T22:39:30.575ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1518, tv_nsec: 188112333 } })
92282024-12-20T22:39:30.576ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
92292024-12-20T22:39:30.576ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.556864ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
92302024-12-20T22:39:30.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
92312024-12-20T22:39:30.577ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92322024-12-20T22:39:30.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92332024-12-20T22:39:30.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92342024-12-20T22:39:30.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92352024-12-20T22:39:30.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92362024-12-20T22:39:30.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92372024-12-20T22:39:30.586ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92382024-12-20T22:39:30.586ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92392024-12-20T22:39:30.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92402024-12-20T22:39:30.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92412024-12-20T22:39:30.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92422024-12-20T22:39:30.593ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1518, tv_nsec: 205442292 } })
92432024-12-20T22:39:30.593ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
92442024-12-20T22:39:30.625ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92452024-12-20T22:39:30.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92462024-12-20T22:39:30.634ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92472024-12-20T22:39:30.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92482024-12-20T22:39:30.636ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92492024-12-20T22:39:30.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92502024-12-20T22:39:30.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92512024-12-20T22:39:30.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92522024-12-20T22:39:30.637ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92532024-12-20T22:39:30.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92542024-12-20T22:39:30.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 64.430788ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
92552024-12-20T22:39:30.638ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92562024-12-20T22:39:30.638ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
92572024-12-20T22:39:30.638ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92582024-12-20T22:39:30.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92592024-12-20T22:39:30.639ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92602024-12-20T22:39:30.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92612024-12-20T22:39:30.640ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
92622024-12-20T22:39:30.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92632024-12-20T22:39:30.653ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92642024-12-20T22:39:30.653ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92652024-12-20T22:39:30.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92662024-12-20T22:39:30.655ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 81.401417ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
92672024-12-20T22:39:30.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92682024-12-20T22:39:30.656ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92692024-12-20T22:39:30.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92702024-12-20T22:39:30.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92712024-12-20T22:39:30.656ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
92722024-12-20T22:39:30.656ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92732024-12-20T22:39:30.657ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "820bb980-ba8c-49cc-b8cd-0492f5b8ad02", "content-length": "26", "date": "Fri, 20 Dec 2024 22:39:30 GMT"} })
92742024-12-20T22:39:30.657ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92752024-12-20T22:39:30.657ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
92762024-12-20T22:39:30.657ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92772024-12-20T22:39:30.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92782024-12-20T22:39:30.657ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
92792024-12-20T22:39:30.657ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92802024-12-20T22:39:30.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92812024-12-20T22:39:30.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
92822024-12-20T22:39:30.659ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92832024-12-20T22:39:30.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92842024-12-20T22:39:30.659ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
92852024-12-20T22:39:30.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92862024-12-20T22:39:30.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92872024-12-20T22:39:30.660ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
92882024-12-20T22:39:30.660ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92892024-12-20T22:39:30.660ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "14cd7533-e9fe-4894-9b3f-33f99711a5f7", "content-length": "26", "date": "Fri, 20 Dec 2024 22:39:30 GMT"} })
92902024-12-20T22:39:30.660ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92912024-12-20T22:39:30.662ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
92922024-12-20T22:39:30.673ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92932024-12-20T22:39:30.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92942024-12-20T22:39:30.684ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 zone_address = fd00:1122:3344:101::2
92952024-12-20T22:39:30.684ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92962024-12-20T22:39:30.684ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "acd4e183-8cb6-4f3b-899b-b9c52559bd0a", "content-length": "26", "date": "Fri, 20 Dec 2024 22:39:30 GMT"} })
92972024-12-20T22:39:30.684ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92982024-12-20T22:39:30.685ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
92992024-12-20T22:39:30.685ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 113.249325ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
93002024-12-20T22:39:30.686ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
93012024-12-20T22:39:30.701ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93022024-12-20T22:39:30.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93032024-12-20T22:39:30.702ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93042024-12-20T22:39:30.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93052024-12-20T22:39:30.703ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 130.158752ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93062024-12-20T22:39:30.705ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93072024-12-20T22:39:30.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93082024-12-20T22:39:30.708ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 134.495442ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
93092024-12-20T22:39:30.712ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 139.14583ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
93102024-12-20T22:39:30.715ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
93112024-12-20T22:39:30.715ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 141.981768ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
93122024-12-20T22:39:30.715ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93132024-12-20T22:39:30.716ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93142024-12-20T22:39:30.716ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
93152024-12-20T22:39:30.716ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93162024-12-20T22:39:30.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93172024-12-20T22:39:30.718ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93182024-12-20T22:39:30.718ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93192024-12-20T22:39:30.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93202024-12-20T22:39:30.745ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 171.73641ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
93212024-12-20T22:39:30.746ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93222024-12-20T22:39:30.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
93232024-12-20T22:39:30.749ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93242024-12-20T22:39:30.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93252024-12-20T22:39:30.751ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 177.724145ms iteration = 28 status = 0
93262024-12-20T22:39:30.759ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93272024-12-20T22:39:30.759ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
93282024-12-20T22:39:30.759ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 186.038894ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
93292024-12-20T22:39:30.781ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93302024-12-20T22:39:30.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93312024-12-20T22:39:30.845ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
93322024-12-20T22:39:30.845ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4db47ae-cc42-4c54-bc27-7f0d694372d1", "content-length": "2", "date": "Fri, 20 Dec 2024 22:39:30 GMT"} })
93332024-12-20T22:39:30.847ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93342024-12-20T22:39:30.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93352024-12-20T22:39:30.853ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 280.298625ms iteration = 31 status = {"physical_disks_added":0}
93362024-12-20T22:39:30.860ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
93372024-12-20T22:39:30.860ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93382024-12-20T22:39:30.860ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "263a2aa2-f765-4eb0-991f-14f21502072b", "content-length": "372", "date": "Fri, 20 Dec 2024 22:39:30 GMT"} })
93392024-12-20T22:39:30.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93402024-12-20T22:39:30.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93412024-12-20T22:39:30.862ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93422024-12-20T22:39:30.862ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 291.71581ms iteration = 28 status = null
93432024-12-20T22:39:30.864ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
93442024-12-20T22:39:30.864ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93452024-12-20T22:39:30.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93462024-12-20T22:39:30.866ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93472024-12-20T22:39:30.866ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 295.782443ms iteration = 28 status = {}
93482024-12-20T22:39:30.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
93492024-12-20T22:39:30.868ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93502024-12-20T22:39:30.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93512024-12-20T22:39:30.916ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
93522024-12-20T22:39:30.916ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
93532024-12-20T22:39:30.916ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "37951bc1-2a1b-439e-9c83-3600a6341489", "date": "Fri, 20 Dec 2024 22:39:30 GMT"} })
93542024-12-20T22:39:30.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93552024-12-20T22:39:30.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93562024-12-20T22:39:30.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93572024-12-20T22:39:30.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93582024-12-20T22:39:30.922ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93592024-12-20T22:39:30.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93602024-12-20T22:39:30.926ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
93612024-12-20T22:39:30.926ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93622024-12-20T22:39:30.926ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3f71540e-d4d2-4dfd-8262-d827f6cddcdf", "date": "Fri, 20 Dec 2024 22:39:30 GMT"} })
93632024-12-20T22:39:30.927ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 354.070781ms iteration = 29 status = {}
93642024-12-20T22:39:30.928ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
93652024-12-20T22:39:30.928ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4cb1c8bb-bca2-4cd9-8fd0-61e956092b21", "content-length": "691", "date": "Fri, 20 Dec 2024 22:39:30 GMT"} })
93662024-12-20T22:39:30.929ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
93672024-12-20T22:39:30.929ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
93682024-12-20T22:39:30.929ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
93692024-12-20T22:39:30.930ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 357.075374ms iteration = 29 status = {}
93702024-12-20T22:39:30.935ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93712024-12-20T22:39:30.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93722024-12-20T22:39:30.937ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9fedf0d4-8a86-4506-bf93-224faabd5e37, rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b26f0563-25fb-4d7c-8480-dd368ac01105) } rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
93732024-12-20T22:39:30.937ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93742024-12-20T22:39:30.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93752024-12-20T22:39:30.946ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
93762024-12-20T22:39:30.947ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "968a26d6-fd5e-42df-8dcf-1a6d30340db0", "content-length": "134", "date": "Fri, 20 Dec 2024 22:39:30 GMT"} })
93772024-12-20T22:39:30.947ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
93782024-12-20T22:39:30.947ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b26f0563-25fb-4d7c-8480-dd368ac01105
93792024-12-20T22:39:30.947ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
93802024-12-20T22:39:30.947ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
93812024-12-20T22:39:30.947ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93822024-12-20T22:39:30.947ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93832024-12-20T22:39:30.947ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93842024-12-20T22:39:30.947ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93852024-12-20T22:39:30.947ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93862024-12-20T22:39:30.947ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93872024-12-20T22:39:30.947ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
93882024-12-20T22:39:30.947ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93892024-12-20T22:39:30.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93902024-12-20T22:39:30.949ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
93912024-12-20T22:39:30.949ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "279e4ea1-05f1-4d82-912e-4ac0bb43fb03", "content-length": "2", "date": "Fri, 20 Dec 2024 22:39:30 GMT"} })
93922024-12-20T22:39:30.949ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
93932024-12-20T22:39:30.949ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea0a9553-4903-414e-87d0-e16458eaa4df", "content-length": "52", "date": "Fri, 20 Dec 2024 22:39:30 GMT"} })
93942024-12-20T22:39:30.949ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
93952024-12-20T22:39:30.949ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
93962024-12-20T22:39:31.046ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "10f54ca1-b2e4-4c33-8524-95de56f058b4", "date": "Fri, 20 Dec 2024 22:39:30 GMT"} })
93972024-12-20T22:39:31.046ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch = Switch0
93982024-12-20T22:39:31.046ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
93992024-12-20T22:39:31.047ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cdc798d-504d-4e44-880c-57af3209aae2", "content-length": "682", "date": "Fri, 20 Dec 2024 22:39:30 GMT"} })
94002024-12-20T22:39:31.047ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94012024-12-20T22:39:31.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94022024-12-20T22:39:31.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94032024-12-20T22:39:31.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94042024-12-20T22:39:31.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94052024-12-20T22:39:31.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94062024-12-20T22:39:31.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94072024-12-20T22:39:31.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94082024-12-20T22:39:31.063ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 489.817577ms iteration = 28 status = {}
94092024-12-20T22:39:31.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c0409b3e-821f-4aa2-b886-766569869fd4 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94102024-12-20T22:39:31.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c0409b3e-821f-4aa2-b886-766569869fd4 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94112024-12-20T22:39:31.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c0409b3e-821f-4aa2-b886-766569869fd4 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94122024-12-20T22:39:31.451ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
94132024-12-20T22:39:31.451ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
94142024-12-20T22:39:31.481ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
94152024-12-20T22:39:31.481ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:43641
94162024-12-20T22:39:31.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:43641 req_id = d08cbba4-8504-4055-9f2f-2e0d71032189 roles = RoleSet { roles: {} } uri = /metrics/producers
94172024-12-20T22:39:31.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:43641 req_id = d08cbba4-8504-4055-9f2f-2e0d71032189 resource = Database result = Ok(()) uri = /metrics/producers
94182024-12-20T22:39:31.541ZINFOnexus: assigned collector to new producer collector_id = a0c68cf7-84ce-4a59-a3f9-ff7d332963b9 file = nexus/src/app/oximeter.rs:76 producer_id = c08fb79e-9df2-49bb-be41-3925df103e75
94192024-12-20T22:39:31.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59557 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:43641 req_id = d08cbba4-8504-4055-9f2f-2e0d71032189 response_code = 201 uri = /metrics/producers
94202024-12-20T22:39:31.541ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "d08cbba4-8504-4055-9f2f-2e0d71032189", "content-length": "41", "date": "Fri, 20 Dec 2024 22:39:31 GMT"} })
94212024-12-20T22:39:31.542ZDEBGnexus (producer-registration-task): registered with nexus successfully
94222024-12-20T22:39:31.542ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
94232024-12-20T22:39:32.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d92f3a2b-c585-40d2-ba4d-4113644ece02 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94242024-12-20T22:39:32.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d92f3a2b-c585-40d2-ba4d-4113644ece02 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94252024-12-20T22:39:32.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d92f3a2b-c585-40d2-ba4d-4113644ece02 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94262024-12-20T22:39:33.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1f4ea751-1f90-4d77-aef4-8882b102f01b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94272024-12-20T22:39:33.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1f4ea751-1f90-4d77-aef4-8882b102f01b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94282024-12-20T22:39:33.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2681 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1f4ea751-1f90-4d77-aef4-8882b102f01b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94292024-12-20T22:39:34.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6a6c1363-ab93-4a26-9f7f-0771ab56c2d9 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94302024-12-20T22:39:34.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6a6c1363-ab93-4a26-9f7f-0771ab56c2d9 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94312024-12-20T22:39:34.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6a6c1363-ab93-4a26-9f7f-0771ab56c2d9 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94322024-12-20T22:39:35.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0d90fff4-2dad-4d04-9aeb-79f393546663 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94332024-12-20T22:39:35.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0d90fff4-2dad-4d04-9aeb-79f393546663 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94342024-12-20T22:39:35.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2685 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0d90fff4-2dad-4d04-9aeb-79f393546663 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94352024-12-20T22:39:35.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 577 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = d4394bed-ba2b-48c3-9f4c-5ff6493aff7e response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
94362024-12-20T22:39:36.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d7685ea0-16b7-4eac-bb01-10689aeb39d7 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94372024-12-20T22:39:36.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d7685ea0-16b7-4eac-bb01-10689aeb39d7 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94382024-12-20T22:39:36.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d7685ea0-16b7-4eac-bb01-10689aeb39d7 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94392024-12-20T22:39:37.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = cc7d7c71-f8b5-42f1-9183-76d925657a9a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
94402024-12-20T22:39:37.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = cc7d7c71-f8b5-42f1-9183-76d925657a9a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
94412024-12-20T22:39:37.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3938 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = cc7d7c71-f8b5-42f1-9183-76d925657a9a response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
94422024-12-20T22:39:37.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 29ef8ceb-c756-4efe-881c-b4a22aa1a635 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94432024-12-20T22:39:37.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 29ef8ceb-c756-4efe-881c-b4a22aa1a635 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94442024-12-20T22:39:37.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 29ef8ceb-c756-4efe-881c-b4a22aa1a635 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94452024-12-20T22:39:38.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 99438380-93e0-4813-893d-8d6b97452a9f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94462024-12-20T22:39:38.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 99438380-93e0-4813-893d-8d6b97452a9f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94472024-12-20T22:39:38.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2655 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 99438380-93e0-4813-893d-8d6b97452a9f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94482024-12-20T22:39:39.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2b66d853-3826-4817-b54a-b74c589329f8 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94492024-12-20T22:39:39.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2b66d853-3826-4817-b54a-b74c589329f8 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94502024-12-20T22:39:39.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2b66d853-3826-4817-b54a-b74c589329f8 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94512024-12-20T22:39:40.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 857ffd5d-64a5-413b-87df-9a11b2358476 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94522024-12-20T22:39:40.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 857ffd5d-64a5-413b-87df-9a11b2358476 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94532024-12-20T22:39:40.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 857ffd5d-64a5-413b-87df-9a11b2358476 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94542024-12-20T22:39:40.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
94552024-12-20T22:39:40.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94562024-12-20T22:39:40.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94572024-12-20T22:39:40.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
94582024-12-20T22:39:40.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94592024-12-20T22:39:40.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94602024-12-20T22:39:40.618ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94612024-12-20T22:39:40.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94622024-12-20T22:39:40.621ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 47.744408ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94632024-12-20T22:39:40.626ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94642024-12-20T22:39:40.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94652024-12-20T22:39:40.628ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94662024-12-20T22:39:40.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94672024-12-20T22:39:40.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94682024-12-20T22:39:40.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94692024-12-20T22:39:40.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94702024-12-20T22:39:40.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
94712024-12-20T22:39:40.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94722024-12-20T22:39:40.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94732024-12-20T22:39:40.648ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
94742024-12-20T22:39:40.648ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 75.947326ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
94752024-12-20T22:39:41.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d24188bc-1999-4bf1-badd-ee62d5ee39a8 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94762024-12-20T22:39:41.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d24188bc-1999-4bf1-badd-ee62d5ee39a8 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94772024-12-20T22:39:41.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1965 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d24188bc-1999-4bf1-badd-ee62d5ee39a8 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94782024-12-20T22:39:42.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 90c2c60f-57fe-4846-9cb7-430ffd4b85b9 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94792024-12-20T22:39:42.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 90c2c60f-57fe-4846-9cb7-430ffd4b85b9 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94802024-12-20T22:39:42.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 90c2c60f-57fe-4846-9cb7-430ffd4b85b9 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94812024-12-20T22:39:43.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 242dbb55-a52c-4605-86f1-733f7c78e7dd roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94822024-12-20T22:39:43.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 242dbb55-a52c-4605-86f1-733f7c78e7dd resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94832024-12-20T22:39:43.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 242dbb55-a52c-4605-86f1-733f7c78e7dd response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94842024-12-20T22:39:44.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f9cb0e12-92d1-447f-88fb-315f437490d4 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94852024-12-20T22:39:44.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f9cb0e12-92d1-447f-88fb-315f437490d4 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94862024-12-20T22:39:44.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f9cb0e12-92d1-447f-88fb-315f437490d4 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94872024-12-20T22:39:45.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 883 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 04dade65-cdc3-41ad-b423-e8bbc4900524 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
94882024-12-20T22:39:45.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 753a8926-90f4-49b1-8e23-2792bfcabd7a roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94892024-12-20T22:39:45.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 753a8926-90f4-49b1-8e23-2792bfcabd7a resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94902024-12-20T22:39:45.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 753a8926-90f4-49b1-8e23-2792bfcabd7a response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94912024-12-20T22:39:46.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2fa7be57-c317-46bb-8b57-d2e4e88749b9 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94922024-12-20T22:39:46.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2fa7be57-c317-46bb-8b57-d2e4e88749b9 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94932024-12-20T22:39:46.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2fa7be57-c317-46bb-8b57-d2e4e88749b9 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94942024-12-20T22:39:47.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9cd73300-c3b9-4dc7-b5af-468df073cc3d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94952024-12-20T22:39:47.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9cd73300-c3b9-4dc7-b5af-468df073cc3d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94962024-12-20T22:39:47.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3015 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9cd73300-c3b9-4dc7-b5af-468df073cc3d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94972024-12-20T22:39:48.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c7c4b148-ac9a-4dcc-bdfe-4f10ad03f70d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94982024-12-20T22:39:48.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c7c4b148-ac9a-4dcc-bdfe-4f10ad03f70d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
94992024-12-20T22:39:48.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c7c4b148-ac9a-4dcc-bdfe-4f10ad03f70d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95002024-12-20T22:39:49.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 609aca46-dde0-45f9-8a55-12087b875ea0 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95012024-12-20T22:39:49.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 609aca46-dde0-45f9-8a55-12087b875ea0 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95022024-12-20T22:39:49.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 609aca46-dde0-45f9-8a55-12087b875ea0 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95032024-12-20T22:39:50.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
95042024-12-20T22:39:50.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95052024-12-20T22:39:50.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95062024-12-20T22:39:50.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
95072024-12-20T22:39:50.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95082024-12-20T22:39:50.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95092024-12-20T22:39:50.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95102024-12-20T22:39:50.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95112024-12-20T22:39:50.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95122024-12-20T22:39:50.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95132024-12-20T22:39:50.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95142024-12-20T22:39:50.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95152024-12-20T22:39:50.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.669862ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95162024-12-20T22:39:50.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95172024-12-20T22:39:50.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95182024-12-20T22:39:50.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95192024-12-20T22:39:50.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
95202024-12-20T22:39:50.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95212024-12-20T22:39:50.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95222024-12-20T22:39:50.591ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
95232024-12-20T22:39:50.591ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.607831ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
95242024-12-20T22:39:50.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4913d4fa-6c67-4f2e-8406-b4c4e6d370ab roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95252024-12-20T22:39:50.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4913d4fa-6c67-4f2e-8406-b4c4e6d370ab resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95262024-12-20T22:39:50.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4913d4fa-6c67-4f2e-8406-b4c4e6d370ab response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95272024-12-20T22:39:51.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5db071ef-2730-4210-bc77-3b48e62b05ea roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95282024-12-20T22:39:51.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5db071ef-2730-4210-bc77-3b48e62b05ea resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95292024-12-20T22:39:51.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5db071ef-2730-4210-bc77-3b48e62b05ea response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95302024-12-20T22:39:52.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d159b823-c0e7-490a-994b-da389b581e48 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95312024-12-20T22:39:52.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d159b823-c0e7-490a-994b-da389b581e48 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95322024-12-20T22:39:52.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2646 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d159b823-c0e7-490a-994b-da389b581e48 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95332024-12-20T22:39:53.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 883163e5-887e-4431-b207-47612f194db9 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95342024-12-20T22:39:53.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 883163e5-887e-4431-b207-47612f194db9 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95352024-12-20T22:39:53.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 883163e5-887e-4431-b207-47612f194db9 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95362024-12-20T22:39:54.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4353dd43-6e3f-43cb-bc4a-599a82e8f91d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95372024-12-20T22:39:54.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4353dd43-6e3f-43cb-bc4a-599a82e8f91d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95382024-12-20T22:39:54.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4353dd43-6e3f-43cb-bc4a-599a82e8f91d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95392024-12-20T22:39:55.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 661 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = f48bd4d1-aa8a-4ccb-9487-4b674e32b44c response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
95402024-12-20T22:39:55.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 61c46dcd-0596-4760-95d7-745c0f8c367c roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95412024-12-20T22:39:55.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 61c46dcd-0596-4760-95d7-745c0f8c367c resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95422024-12-20T22:39:55.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 61c46dcd-0596-4760-95d7-745c0f8c367c response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95432024-12-20T22:39:56.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7478fc05-364b-4b0d-9d28-66db4728e3f6 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95442024-12-20T22:39:56.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7478fc05-364b-4b0d-9d28-66db4728e3f6 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95452024-12-20T22:39:56.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7478fc05-364b-4b0d-9d28-66db4728e3f6 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95462024-12-20T22:39:57.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 55a2671d-990d-4002-94f9-0d0dc1f33808 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95472024-12-20T22:39:57.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 55a2671d-990d-4002-94f9-0d0dc1f33808 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95482024-12-20T22:39:57.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 55a2671d-990d-4002-94f9-0d0dc1f33808 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95492024-12-20T22:39:58.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6da2fed7-8738-4585-bad8-2ead14a299e1 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95502024-12-20T22:39:58.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6da2fed7-8738-4585-bad8-2ead14a299e1 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95512024-12-20T22:39:58.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6da2fed7-8738-4585-bad8-2ead14a299e1 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95522024-12-20T22:39:59.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 995b62f4-040d-4e01-b897-ff933af8b6eb roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95532024-12-20T22:39:59.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 995b62f4-040d-4e01-b897-ff933af8b6eb resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95542024-12-20T22:39:59.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2830 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 995b62f4-040d-4e01-b897-ff933af8b6eb response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
95552024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
95562024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
95572024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
95582024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
95592024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
95602024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
95612024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
95622024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
95632024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
95642024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
95652024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
95662024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
95672024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
95682024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
95692024-12-20T22:40:00.571ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:30:00.571332499 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
95702024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
95712024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
95722024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
95732024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
95742024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
95752024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
95762024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
95772024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
95782024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
95792024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
95802024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
95812024-12-20T22:40:00.571ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bcf7579-f08c-458a-b8fa-486beafab77e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c65750e1-e505-4d05-b242-145c69974016.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c65750e1-e505-4d05-b242-145c69974016.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1548, tv_nsec: 184255527 } })
95822024-12-20T22:40:00.571ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b172144-6fe3-403a-b88e-6be93db6788c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e1e925bb-4266-49d2-b532-0f79860badbb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9d7e78a-d944-4f23-9be0-86e0f1334a43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9d7e78a-d944-4f23-9be0-86e0f1334a43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1548, tv_nsec: 184259767 } })
95832024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
95842024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
95852024-12-20T22:40:00.571ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e
95862024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95872024-12-20T22:40:00.571ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.461\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e"}
95882024-12-20T22:40:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95892024-12-20T22:40:00.572ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
95902024-12-20T22:40:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.011208ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
95912024-12-20T22:40:00.572ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
95922024-12-20T22:40:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.132811ms iteration = 15 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
95932024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
95942024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
95952024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
95962024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95972024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95982024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95992024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
96002024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
96012024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
96022024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96032024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
96042024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
96052024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96062024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96072024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
96082024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96092024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
96102024-12-20T22:40:00.573ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
96112024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96122024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
96132024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
96142024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
96152024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
96162024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
96172024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
96182024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96192024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
96202024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
96212024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
96222024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96232024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
96242024-12-20T22:40:00.573ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
96252024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
96262024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
96272024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96282024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
96292024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
96302024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96312024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
96322024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96332024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96342024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96352024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
96362024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96372024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96382024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
96392024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96402024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
96412024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
96422024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
96432024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
96442024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
96452024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96462024-12-20T22:40:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
96472024-12-20T22:40:00.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1548, tv_nsec: 186456717 } })
96482024-12-20T22:40:00.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
96492024-12-20T22:40:00.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96502024-12-20T22:40:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96512024-12-20T22:40:00.575ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1548, tv_nsec: 187422504 } })
96522024-12-20T22:40:00.575ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
96532024-12-20T22:40:00.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96542024-12-20T22:40:00.575ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.368401ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
96552024-12-20T22:40:00.575ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:30:00.571332499 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
96562024-12-20T22:40:00.575ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.391232ms iteration = 15 status = {"expiration":"2024-12-20T22:30:00.571332499Z","pruned":[]}
96572024-12-20T22:40:00.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96582024-12-20T22:40:00.576ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96592024-12-20T22:40:00.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96602024-12-20T22:40:00.577ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96612024-12-20T22:40:00.578ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
96622024-12-20T22:40:00.578ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96632024-12-20T22:40:00.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96642024-12-20T22:40:00.579ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96652024-12-20T22:40:00.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96662024-12-20T22:40:00.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96672024-12-20T22:40:00.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96682024-12-20T22:40:00.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
96692024-12-20T22:40:00.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96702024-12-20T22:40:00.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96712024-12-20T22:40:00.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
96722024-12-20T22:40:00.582ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96732024-12-20T22:40:00.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96742024-12-20T22:40:00.584ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96752024-12-20T22:40:00.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
96762024-12-20T22:40:00.587ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96772024-12-20T22:40:00.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96782024-12-20T22:40:00.589ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.180507ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
96792024-12-20T22:40:00.590ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96802024-12-20T22:40:00.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
96812024-12-20T22:40:00.597ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
96822024-12-20T22:40:00.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
96832024-12-20T22:40:00.602ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96842024-12-20T22:40:00.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96852024-12-20T22:40:00.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96862024-12-20T22:40:00.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96872024-12-20T22:40:00.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96882024-12-20T22:40:00.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96892024-12-20T22:40:00.618ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96902024-12-20T22:40:00.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96912024-12-20T22:40:00.619ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1548, tv_nsec: 232191460 } })
96922024-12-20T22:40:00.620ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
96932024-12-20T22:40:00.641ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96942024-12-20T22:40:00.644ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 71.069161ms iteration = 29 status = {"errors":[],"finish_invoked_ok":[]}
96952024-12-20T22:40:00.644ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
96962024-12-20T22:40:00.644ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
96972024-12-20T22:40:00.644ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 71.336289ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
96982024-12-20T22:40:00.644ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
96992024-12-20T22:40:00.644ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97002024-12-20T22:40:00.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97012024-12-20T22:40:00.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97022024-12-20T22:40:00.647ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97032024-12-20T22:40:00.648ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97042024-12-20T22:40:00.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97052024-12-20T22:40:00.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97062024-12-20T22:40:00.649ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97072024-12-20T22:40:00.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97082024-12-20T22:40:00.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
97092024-12-20T22:40:00.651ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97102024-12-20T22:40:00.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97112024-12-20T22:40:00.653ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 80.331077ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
97122024-12-20T22:40:00.654ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97132024-12-20T22:40:00.654ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97142024-12-20T22:40:00.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97152024-12-20T22:40:00.654ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97162024-12-20T22:40:00.654ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97172024-12-20T22:40:00.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97182024-12-20T22:40:00.656ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97192024-12-20T22:40:00.656ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97202024-12-20T22:40:00.657ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
97212024-12-20T22:40:00.657ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97222024-12-20T22:40:00.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97232024-12-20T22:40:00.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97242024-12-20T22:40:00.658ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97252024-12-20T22:40:00.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97262024-12-20T22:40:00.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 86.286241ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
97272024-12-20T22:40:00.661ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97282024-12-20T22:40:00.662ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97292024-12-20T22:40:00.662ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
97302024-12-20T22:40:00.662ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97312024-12-20T22:40:00.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97322024-12-20T22:40:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
97332024-12-20T22:40:00.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97342024-12-20T22:40:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97352024-12-20T22:40:00.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97362024-12-20T22:40:00.671ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
97372024-12-20T22:40:00.671ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 99.053604ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
97382024-12-20T22:40:00.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
97392024-12-20T22:40:00.674ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
97402024-12-20T22:40:00.674ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
97412024-12-20T22:40:00.674ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 101.503332ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
97422024-12-20T22:40:00.676ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97432024-12-20T22:40:00.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
97442024-12-20T22:40:00.678ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97452024-12-20T22:40:00.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97462024-12-20T22:40:00.708ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
97472024-12-20T22:40:00.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
97482024-12-20T22:40:00.714ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 141.158885ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
97492024-12-20T22:40:00.716ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 143.342695ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
97502024-12-20T22:40:00.716ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97512024-12-20T22:40:00.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97522024-12-20T22:40:00.719ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
97532024-12-20T22:40:00.719ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 146.469262ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
97542024-12-20T22:40:00.726ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
97552024-12-20T22:40:00.726ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
97562024-12-20T22:40:00.726ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
97572024-12-20T22:40:00.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97582024-12-20T22:40:00.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97592024-12-20T22:40:00.730ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
97602024-12-20T22:40:00.730ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
97612024-12-20T22:40:00.730ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
97622024-12-20T22:40:00.730ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
97632024-12-20T22:40:00.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97642024-12-20T22:40:00.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97652024-12-20T22:40:00.731ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
97662024-12-20T22:40:00.764ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97672024-12-20T22:40:00.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97682024-12-20T22:40:00.776ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 zone_address = fd00:1122:3344:101::2
97692024-12-20T22:40:00.776ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97702024-12-20T22:40:00.776ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "129e09b1-51f4-4d1a-aced-19a24604874d", "content-length": "26", "date": "Fri, 20 Dec 2024 22:40:00 GMT"} })
97712024-12-20T22:40:00.776ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97722024-12-20T22:40:00.778ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
97732024-12-20T22:40:00.801ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 228.587439ms iteration = 32 status = {"physical_disks_added":0}
97742024-12-20T22:40:00.819ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
97752024-12-20T22:40:00.819ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
97762024-12-20T22:40:00.819ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef1ec4a0-b0e2-4d46-85f3-4d348a5dcd81", "content-length": "372", "date": "Fri, 20 Dec 2024 22:40:00 GMT"} })
97772024-12-20T22:40:00.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97782024-12-20T22:40:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97792024-12-20T22:40:00.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f5f905d6-84ea-4a35-b1e2-4a587441c3a7 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
97802024-12-20T22:40:00.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f5f905d6-84ea-4a35-b1e2-4a587441c3a7 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
97812024-12-20T22:40:00.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97822024-12-20T22:40:00.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97832024-12-20T22:40:00.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97842024-12-20T22:40:00.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = f5f905d6-84ea-4a35-b1e2-4a587441c3a7 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
97852024-12-20T22:40:00.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
97862024-12-20T22:40:00.826ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97872024-12-20T22:40:00.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97882024-12-20T22:40:00.860ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
97892024-12-20T22:40:00.861ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97902024-12-20T22:40:00.861ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e48bd182-b184-42fe-9dce-2a1a680e08fd", "content-length": "26", "date": "Fri, 20 Dec 2024 22:40:00 GMT"} })
97912024-12-20T22:40:00.861ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97922024-12-20T22:40:00.862ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
97932024-12-20T22:40:00.862ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97942024-12-20T22:40:00.862ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8189801e-e38e-4df4-a931-b9f3ca1f6d05", "content-length": "26", "date": "Fri, 20 Dec 2024 22:40:00 GMT"} })
97952024-12-20T22:40:00.862ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97962024-12-20T22:40:00.865ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
97972024-12-20T22:40:00.866ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
97982024-12-20T22:40:00.875ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97992024-12-20T22:40:00.875ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
98002024-12-20T22:40:00.875ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98012024-12-20T22:40:00.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98022024-12-20T22:40:00.877ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98032024-12-20T22:40:00.879ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 306.352144ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
98042024-12-20T22:40:00.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98052024-12-20T22:40:00.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98062024-12-20T22:40:00.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98072024-12-20T22:40:00.883ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98082024-12-20T22:40:00.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98092024-12-20T22:40:00.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98102024-12-20T22:40:00.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
98112024-12-20T22:40:00.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98122024-12-20T22:40:00.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98132024-12-20T22:40:00.887ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
98142024-12-20T22:40:00.887ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
98152024-12-20T22:40:00.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98162024-12-20T22:40:00.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98172024-12-20T22:40:00.888ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 315.300832ms iteration = 29 status = 0
98182024-12-20T22:40:00.889ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98192024-12-20T22:40:00.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98202024-12-20T22:40:00.891ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98212024-12-20T22:40:00.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98222024-12-20T22:40:00.894ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
98232024-12-20T22:40:00.894ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
98242024-12-20T22:40:00.894ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:26:39.700273 UTC dns_group = internal generation = 1
98252024-12-20T22:40:00.894ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 322.797548ms iteration = 15 status = {"generation":1}
98262024-12-20T22:40:00.898ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
98272024-12-20T22:40:00.899ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
98282024-12-20T22:40:00.899ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
98292024-12-20T22:40:00.899ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1331d96d-442c-4cb3-83ba-8509bc44f7f8", "date": "Fri, 20 Dec 2024 22:40:00 GMT"} })
98302024-12-20T22:40:00.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98312024-12-20T22:40:00.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98322024-12-20T22:40:00.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98332024-12-20T22:40:00.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98342024-12-20T22:40:00.904ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
98352024-12-20T22:40:00.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98362024-12-20T22:40:00.904ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f36c2043-4abf-426e-8da2-92a4b2690e66", "date": "Fri, 20 Dec 2024 22:40:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98372024-12-20T22:40:00.904ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98382024-12-20T22:40:00.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98392024-12-20T22:40:00.906ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c3007d4a-5292-4e83-84f5-a5e73dc2cf46", "date": "Fri, 20 Dec 2024 22:40:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98402024-12-20T22:40:00.906ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98412024-12-20T22:40:00.907ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
98422024-12-20T22:40:00.907ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98432024-12-20T22:40:00.908ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98442024-12-20T22:40:00.908ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b9045040-bc60-458e-aa06-38237ddf167a", "date": "Fri, 20 Dec 2024 22:40:00 GMT"} })
98452024-12-20T22:40:00.908ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 336.880006ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
98462024-12-20T22:40:00.909ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 336.415453ms iteration = 30 status = {}
98472024-12-20T22:40:00.921ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98482024-12-20T22:40:00.924ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
98492024-12-20T22:40:00.924ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98502024-12-20T22:40:00.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98512024-12-20T22:40:00.924ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98522024-12-20T22:40:00.924ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
98532024-12-20T22:40:00.924ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 351.337456ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
98542024-12-20T22:40:00.933ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
98552024-12-20T22:40:00.933ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 0 version = 2
98562024-12-20T22:40:00.933ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98572024-12-20T22:40:00.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98582024-12-20T22:40:00.934ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98592024-12-20T22:40:00.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98602024-12-20T22:40:00.937ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98612024-12-20T22:40:00.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98622024-12-20T22:40:00.939ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 1 version = 2
98632024-12-20T22:40:00.939ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
98642024-12-20T22:40:00.939ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:26:40.428768 UTC dns_group = external generation = 2
98652024-12-20T22:40:00.939ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 368.600383ms iteration = 15 status = {"generation":2}
98662024-12-20T22:40:00.971ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
98672024-12-20T22:40:00.971ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 398.136677ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
98682024-12-20T22:40:00.976ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:25:57.040586Z, time_modified: 2024-12-20T22:25:57.040586Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }) }
98692024-12-20T22:40:00.976ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 405.52374ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]}},"default_endpoint":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
98702024-12-20T22:40:00.986ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 415.057024ms iteration = 29 status = {}
98712024-12-20T22:40:00.987ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98722024-12-20T22:40:00.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98732024-12-20T22:40:00.989ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98742024-12-20T22:40:00.991ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98752024-12-20T22:40:00.991ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98762024-12-20T22:40:00.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98772024-12-20T22:40:01.000ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
98782024-12-20T22:40:01.000ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc482437-83ed-4d13-9454-846a8be6efde", "content-length": "2", "date": "Fri, 20 Dec 2024 22:40:00 GMT"} })
98792024-12-20T22:40:01.001ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
98802024-12-20T22:40:01.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
98812024-12-20T22:40:01.004ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 432.913006ms iteration = 29 status = null
98822024-12-20T22:40:01.005ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
98832024-12-20T22:40:01.005ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f73d5bed-04c9-4555-a16e-9db780263b9a", "date": "Fri, 20 Dec 2024 22:40:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
98842024-12-20T22:40:01.005ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
98852024-12-20T22:40:01.007ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "265b3c96-90d2-48c2-bf22-65e6bbb4f2c4", "date": "Fri, 20 Dec 2024 22:40:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
98862024-12-20T22:40:01.007ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
98872024-12-20T22:40:01.009ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d2aaebf7-792a-49b4-a7e2-a319d0a8735a", "date": "Fri, 20 Dec 2024 22:40:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
98882024-12-20T22:40:01.009ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
98892024-12-20T22:40:01.011ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
98902024-12-20T22:40:01.011ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 440.327271ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
98912024-12-20T22:40:01.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98922024-12-20T22:40:01.034ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98932024-12-20T22:40:01.035ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98942024-12-20T22:40:01.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98952024-12-20T22:40:01.040ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98962024-12-20T22:40:01.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98972024-12-20T22:40:01.045ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9fedf0d4-8a86-4506-bf93-224faabd5e37, rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b26f0563-25fb-4d7c-8480-dd368ac01105) } rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
98982024-12-20T22:40:01.045ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98992024-12-20T22:40:01.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99002024-12-20T22:40:01.053ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
99012024-12-20T22:40:01.053ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0606267-86ea-45c0-80f8-68dd072c6347", "content-length": "134", "date": "Fri, 20 Dec 2024 22:40:00 GMT"} })
99022024-12-20T22:40:01.053ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
99032024-12-20T22:40:01.053ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b26f0563-25fb-4d7c-8480-dd368ac01105
99042024-12-20T22:40:01.053ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
99052024-12-20T22:40:01.053ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
99062024-12-20T22:40:01.053ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99072024-12-20T22:40:01.053ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99082024-12-20T22:40:01.053ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99092024-12-20T22:40:01.053ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99102024-12-20T22:40:01.053ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99112024-12-20T22:40:01.053ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99122024-12-20T22:40:01.054ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
99132024-12-20T22:40:01.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99142024-12-20T22:40:01.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99152024-12-20T22:40:01.056ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
99162024-12-20T22:40:01.056ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1faacb7-9798-4c69-9e3a-90e1ee2ce141", "content-length": "2", "date": "Fri, 20 Dec 2024 22:40:00 GMT"} })
99172024-12-20T22:40:01.056ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
99182024-12-20T22:40:01.056ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfbdd061-8d6d-4c81-bdb0-360057458a1b", "content-length": "52", "date": "Fri, 20 Dec 2024 22:40:00 GMT"} })
99192024-12-20T22:40:01.056ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
99202024-12-20T22:40:01.056ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
99212024-12-20T22:40:01.068ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
99222024-12-20T22:40:01.158ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "83c870c8-1fdf-4eec-b9a5-a28ad4d6f9fc", "date": "Fri, 20 Dec 2024 22:40:00 GMT"} })
99232024-12-20T22:40:01.158ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch = Switch0
99242024-12-20T22:40:01.158ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
99252024-12-20T22:40:01.158ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a1e4c2e-329b-496b-a088-f0f0d81cca57", "content-length": "691", "date": "Fri, 20 Dec 2024 22:40:00 GMT"} })
99262024-12-20T22:40:01.158ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
99272024-12-20T22:40:01.158ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
99282024-12-20T22:40:01.158ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
99292024-12-20T22:40:01.158ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "417d13a6-d8ca-47e6-899f-081cb151fde1", "content-length": "682", "date": "Fri, 20 Dec 2024 22:40:00 GMT"} })
99302024-12-20T22:40:01.158ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99312024-12-20T22:40:01.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99322024-12-20T22:40:01.160ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 587.3997ms iteration = 30 status = {}
99332024-12-20T22:40:01.163ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99342024-12-20T22:40:01.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99352024-12-20T22:40:01.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99362024-12-20T22:40:01.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99372024-12-20T22:40:01.168ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99382024-12-20T22:40:01.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99392024-12-20T22:40:01.176ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 603.606187ms iteration = 29 status = {}
99402024-12-20T22:40:01.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 43abe23c-c6b9-42d1-ae3a-1062a06986db roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99412024-12-20T22:40:01.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 43abe23c-c6b9-42d1-ae3a-1062a06986db resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99422024-12-20T22:40:01.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2053 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 43abe23c-c6b9-42d1-ae3a-1062a06986db response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99432024-12-20T22:40:02.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e08f206e-f187-4136-bbb4-4478b28589c2 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99442024-12-20T22:40:02.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e08f206e-f187-4136-bbb4-4478b28589c2 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99452024-12-20T22:40:02.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e08f206e-f187-4136-bbb4-4478b28589c2 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99462024-12-20T22:40:03.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 64a57c05-ade4-48de-8e7c-27e3c569627e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99472024-12-20T22:40:03.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 64a57c05-ade4-48de-8e7c-27e3c569627e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99482024-12-20T22:40:03.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2884 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 64a57c05-ade4-48de-8e7c-27e3c569627e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99492024-12-20T22:40:04.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1f0a42d4-3ad9-47b1-aae8-2a243dc3e3a5 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99502024-12-20T22:40:04.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1f0a42d4-3ad9-47b1-aae8-2a243dc3e3a5 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99512024-12-20T22:40:04.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2615 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1f0a42d4-3ad9-47b1-aae8-2a243dc3e3a5 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99522024-12-20T22:40:05.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 582 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 8d516f23-1156-4741-9368-09b370a766ae response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
99532024-12-20T22:40:05.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 99ce1be6-5c57-4439-9dc8-611a2f103720 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99542024-12-20T22:40:05.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 99ce1be6-5c57-4439-9dc8-611a2f103720 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99552024-12-20T22:40:05.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 99ce1be6-5c57-4439-9dc8-611a2f103720 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99562024-12-20T22:40:06.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 730956d8-d92b-46ef-9f46-bde9ddd83b9b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99572024-12-20T22:40:06.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 730956d8-d92b-46ef-9f46-bde9ddd83b9b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99582024-12-20T22:40:06.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 730956d8-d92b-46ef-9f46-bde9ddd83b9b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99592024-12-20T22:40:07.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = cb6d51e7-e27e-4e2c-b525-3392fe5e6b5a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
99602024-12-20T22:40:07.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = cb6d51e7-e27e-4e2c-b525-3392fe5e6b5a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
99612024-12-20T22:40:07.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = cb6d51e7-e27e-4e2c-b525-3392fe5e6b5a response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
99622024-12-20T22:40:07.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4bde4f7e-5e77-4d53-9500-ee13ab986759 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99632024-12-20T22:40:07.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4bde4f7e-5e77-4d53-9500-ee13ab986759 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99642024-12-20T22:40:07.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4bde4f7e-5e77-4d53-9500-ee13ab986759 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99652024-12-20T22:40:09.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = db54acc1-a391-4a13-87d6-c693004aa6d3 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99662024-12-20T22:40:09.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = db54acc1-a391-4a13-87d6-c693004aa6d3 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99672024-12-20T22:40:09.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = db54acc1-a391-4a13-87d6-c693004aa6d3 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99682024-12-20T22:40:10.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8c3a1477-4246-49bb-a75e-bf9dbdb7d34f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99692024-12-20T22:40:10.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8c3a1477-4246-49bb-a75e-bf9dbdb7d34f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99702024-12-20T22:40:10.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8c3a1477-4246-49bb-a75e-bf9dbdb7d34f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99712024-12-20T22:40:10.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
99722024-12-20T22:40:10.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99732024-12-20T22:40:10.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99742024-12-20T22:40:10.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
99752024-12-20T22:40:10.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99762024-12-20T22:40:10.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99772024-12-20T22:40:10.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99782024-12-20T22:40:10.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99792024-12-20T22:40:10.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99802024-12-20T22:40:10.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99812024-12-20T22:40:10.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99822024-12-20T22:40:10.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99832024-12-20T22:40:10.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99842024-12-20T22:40:10.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
99852024-12-20T22:40:10.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99862024-12-20T22:40:10.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99872024-12-20T22:40:10.595ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
99882024-12-20T22:40:10.595ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.512809ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
99892024-12-20T22:40:10.615ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99902024-12-20T22:40:10.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99912024-12-20T22:40:10.655ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 82.128797ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99922024-12-20T22:40:11.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5579622e-e198-4265-83f1-afcf436d6d36 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99932024-12-20T22:40:11.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5579622e-e198-4265-83f1-afcf436d6d36 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99942024-12-20T22:40:11.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5579622e-e198-4265-83f1-afcf436d6d36 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99952024-12-20T22:40:12.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 330b8d89-6134-4e2e-84d6-0db205189c47 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99962024-12-20T22:40:12.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 330b8d89-6134-4e2e-84d6-0db205189c47 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99972024-12-20T22:40:12.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 330b8d89-6134-4e2e-84d6-0db205189c47 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99982024-12-20T22:40:13.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 331d2648-faab-46c3-abca-b70315c8f4b8 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
99992024-12-20T22:40:13.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 331d2648-faab-46c3-abca-b70315c8f4b8 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100002024-12-20T22:40:13.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2614 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 331d2648-faab-46c3-abca-b70315c8f4b8 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100012024-12-20T22:40:14.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1b9bc374-bb33-416f-8197-73665223a4a7 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100022024-12-20T22:40:14.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1b9bc374-bb33-416f-8197-73665223a4a7 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100032024-12-20T22:40:14.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1b9bc374-bb33-416f-8197-73665223a4a7 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100042024-12-20T22:40:15.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7a671935-f2da-4f08-b9df-353372dfc775 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100052024-12-20T22:40:15.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7a671935-f2da-4f08-b9df-353372dfc775 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100062024-12-20T22:40:15.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 7a671935-f2da-4f08-b9df-353372dfc775 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100072024-12-20T22:40:15.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1018 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 1fc485ba-6e71-4420-b92e-65a63f2ed3b2 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
100082024-12-20T22:40:16.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fc59097e-185e-4542-b190-1785d009c6dc roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100092024-12-20T22:40:16.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fc59097e-185e-4542-b190-1785d009c6dc resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100102024-12-20T22:40:16.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fc59097e-185e-4542-b190-1785d009c6dc response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100112024-12-20T22:40:17.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = baaaa24f-2801-4b9c-a925-5d856b70e8b2 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100122024-12-20T22:40:17.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = baaaa24f-2801-4b9c-a925-5d856b70e8b2 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100132024-12-20T22:40:17.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = baaaa24f-2801-4b9c-a925-5d856b70e8b2 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100142024-12-20T22:40:18.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 582f13b3-78df-47f0-9a48-6aa5f01aaba0 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100152024-12-20T22:40:18.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 582f13b3-78df-47f0-9a48-6aa5f01aaba0 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100162024-12-20T22:40:18.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 582f13b3-78df-47f0-9a48-6aa5f01aaba0 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100172024-12-20T22:40:19.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 76902b03-92c3-45d8-8ea7-1ad687c2416e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100182024-12-20T22:40:19.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 76902b03-92c3-45d8-8ea7-1ad687c2416e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100192024-12-20T22:40:19.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 76902b03-92c3-45d8-8ea7-1ad687c2416e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100202024-12-20T22:40:20.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b88cb132-1a6e-4af8-8997-72b614340556 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100212024-12-20T22:40:20.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b88cb132-1a6e-4af8-8997-72b614340556 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100222024-12-20T22:40:20.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b88cb132-1a6e-4af8-8997-72b614340556 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100232024-12-20T22:40:20.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
100242024-12-20T22:40:20.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100252024-12-20T22:40:20.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100262024-12-20T22:40:20.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
100272024-12-20T22:40:20.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100282024-12-20T22:40:20.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100292024-12-20T22:40:20.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100302024-12-20T22:40:20.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100312024-12-20T22:40:20.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100322024-12-20T22:40:20.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100332024-12-20T22:40:20.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100342024-12-20T22:40:20.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100352024-12-20T22:40:20.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100362024-12-20T22:40:20.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
100372024-12-20T22:40:20.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100382024-12-20T22:40:20.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100392024-12-20T22:40:20.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
100402024-12-20T22:40:20.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.912169ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
100412024-12-20T22:40:20.614ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100422024-12-20T22:40:20.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100432024-12-20T22:40:20.616ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.086409ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100442024-12-20T22:40:21.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 58cc61f5-2c51-4379-a141-0ce94d173b7e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100452024-12-20T22:40:21.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 58cc61f5-2c51-4379-a141-0ce94d173b7e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100462024-12-20T22:40:21.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 58cc61f5-2c51-4379-a141-0ce94d173b7e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100472024-12-20T22:40:22.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 086b1fd6-3e12-41d1-ae35-97480a804808 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100482024-12-20T22:40:22.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 086b1fd6-3e12-41d1-ae35-97480a804808 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100492024-12-20T22:40:22.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 086b1fd6-3e12-41d1-ae35-97480a804808 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100502024-12-20T22:40:23.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9375648c-3d72-4abf-b99e-494d7f979db3 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100512024-12-20T22:40:23.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9375648c-3d72-4abf-b99e-494d7f979db3 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100522024-12-20T22:40:23.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9375648c-3d72-4abf-b99e-494d7f979db3 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100532024-12-20T22:40:24.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 03a52021-4116-42de-9e4b-c427a34a4d69 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100542024-12-20T22:40:24.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 03a52021-4116-42de-9e4b-c427a34a4d69 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100552024-12-20T22:40:24.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 03a52021-4116-42de-9e4b-c427a34a4d69 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100562024-12-20T22:40:25.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 691 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 608a49c9-83c4-4391-9639-091107b327e9 response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
100572024-12-20T22:40:25.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9c22cf8e-e425-4f83-8c06-a169b918272c roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100582024-12-20T22:40:25.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9c22cf8e-e425-4f83-8c06-a169b918272c resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100592024-12-20T22:40:25.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9c22cf8e-e425-4f83-8c06-a169b918272c response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100602024-12-20T22:40:26.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 089c3c50-f0f1-4b2b-8eff-563d9b4ff7b7 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100612024-12-20T22:40:26.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 089c3c50-f0f1-4b2b-8eff-563d9b4ff7b7 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100622024-12-20T22:40:26.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2690 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 089c3c50-f0f1-4b2b-8eff-563d9b4ff7b7 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100632024-12-20T22:40:27.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ce40bd02-48cd-48f9-b2a9-e6f8d21b8875 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100642024-12-20T22:40:27.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ce40bd02-48cd-48f9-b2a9-e6f8d21b8875 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100652024-12-20T22:40:27.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2647 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ce40bd02-48cd-48f9-b2a9-e6f8d21b8875 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100662024-12-20T22:40:28.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1f34840e-1a60-4d95-9abe-5dbd5fccba17 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100672024-12-20T22:40:28.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1f34840e-1a60-4d95-9abe-5dbd5fccba17 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100682024-12-20T22:40:28.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2721 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1f34840e-1a60-4d95-9abe-5dbd5fccba17 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100692024-12-20T22:40:29.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ca02c94a-cfb4-45c1-bde8-62bcdc3a3ca5 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100702024-12-20T22:40:29.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ca02c94a-cfb4-45c1-bde8-62bcdc3a3ca5 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100712024-12-20T22:40:29.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ca02c94a-cfb4-45c1-bde8-62bcdc3a3ca5 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100722024-12-20T22:40:30.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 10ce30ed-53b6-4d05-9a3b-9e1928dd82bd roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100732024-12-20T22:40:30.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 10ce30ed-53b6-4d05-9a3b-9e1928dd82bd resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100742024-12-20T22:40:30.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 10ce30ed-53b6-4d05-9a3b-9e1928dd82bd response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
100752024-12-20T22:40:30.571ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
100762024-12-20T22:40:30.571ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
100772024-12-20T22:40:30.571ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
100782024-12-20T22:40:30.571ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
100792024-12-20T22:40:30.571ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
100802024-12-20T22:40:30.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
100812024-12-20T22:40:30.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
100822024-12-20T22:40:30.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
100832024-12-20T22:40:30.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100842024-12-20T22:40:30.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100852024-12-20T22:40:30.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
100862024-12-20T22:40:30.573ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
100872024-12-20T22:40:30.573ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
100882024-12-20T22:40:30.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100892024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
100902024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100912024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
100922024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
100932024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100942024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
100952024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100962024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
100972024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
100982024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
100992024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
101002024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
101012024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
101022024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
101032024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
101042024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101052024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
101062024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
101072024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101082024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101092024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
101102024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101112024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
101122024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101132024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101142024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101152024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101162024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101172024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101182024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
101192024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101202024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101212024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101222024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101232024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101242024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101252024-12-20T22:40:30.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
101262024-12-20T22:40:30.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1578, tv_nsec: 187334982 } })
101272024-12-20T22:40:30.575ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
101282024-12-20T22:40:30.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101292024-12-20T22:40:30.575ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1578, tv_nsec: 187930428 } })
101302024-12-20T22:40:30.575ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
101312024-12-20T22:40:30.576ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.595537ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
101322024-12-20T22:40:30.576ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101332024-12-20T22:40:30.576ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101342024-12-20T22:40:30.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101352024-12-20T22:40:30.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101362024-12-20T22:40:30.579ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101372024-12-20T22:40:30.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101382024-12-20T22:40:30.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101392024-12-20T22:40:30.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101402024-12-20T22:40:30.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101412024-12-20T22:40:30.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101422024-12-20T22:40:30.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101432024-12-20T22:40:30.581ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101442024-12-20T22:40:30.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101452024-12-20T22:40:30.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101462024-12-20T22:40:30.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101472024-12-20T22:40:30.582ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101482024-12-20T22:40:30.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
101492024-12-20T22:40:30.584ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101502024-12-20T22:40:30.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101512024-12-20T22:40:30.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
101522024-12-20T22:40:30.585ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101532024-12-20T22:40:30.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101542024-12-20T22:40:30.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
101552024-12-20T22:40:30.585ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101562024-12-20T22:40:30.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101572024-12-20T22:40:30.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101582024-12-20T22:40:30.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101592024-12-20T22:40:30.589ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101602024-12-20T22:40:30.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101612024-12-20T22:40:30.590ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101622024-12-20T22:40:30.591ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101632024-12-20T22:40:30.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101642024-12-20T22:40:30.591ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1578, tv_nsec: 203487038 } })
101652024-12-20T22:40:30.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101662024-12-20T22:40:30.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101672024-12-20T22:40:30.591ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
101682024-12-20T22:40:30.591ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101692024-12-20T22:40:30.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101702024-12-20T22:40:30.593ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101712024-12-20T22:40:30.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101722024-12-20T22:40:30.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
101732024-12-20T22:40:30.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101742024-12-20T22:40:30.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101752024-12-20T22:40:30.622ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
101762024-12-20T22:40:30.622ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.29158ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
101772024-12-20T22:40:30.628ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101782024-12-20T22:40:30.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101792024-12-20T22:40:30.631ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101802024-12-20T22:40:30.631ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101812024-12-20T22:40:30.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101822024-12-20T22:40:30.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101832024-12-20T22:40:30.632ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.963367ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101842024-12-20T22:40:30.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101852024-12-20T22:40:30.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101862024-12-20T22:40:30.634ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.755976ms iteration = 30 status = {"errors":[],"finish_invoked_ok":[]}
101872024-12-20T22:40:30.636ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101882024-12-20T22:40:30.638ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101892024-12-20T22:40:30.638ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101902024-12-20T22:40:30.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101912024-12-20T22:40:30.645ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
101922024-12-20T22:40:30.645ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 71.174434ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
101932024-12-20T22:40:30.647ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 73.148408ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
101942024-12-20T22:40:30.650ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101952024-12-20T22:40:30.650ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
101962024-12-20T22:40:30.650ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101972024-12-20T22:40:30.650ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101982024-12-20T22:40:30.650ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101992024-12-20T22:40:30.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102002024-12-20T22:40:30.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
102012024-12-20T22:40:30.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102022024-12-20T22:40:30.652ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 78.837716ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
102032024-12-20T22:40:30.653ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102042024-12-20T22:40:30.653ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
102052024-12-20T22:40:30.653ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102062024-12-20T22:40:30.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102072024-12-20T22:40:30.664ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 90.622271ms iteration = 33 status = {"physical_disks_added":0}
102082024-12-20T22:40:30.665ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
102092024-12-20T22:40:30.665ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102102024-12-20T22:40:30.666ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e24a0cd-5356-4cd2-9994-67092f190ee2", "content-length": "26", "date": "Fri, 20 Dec 2024 22:40:30 GMT"} })
102112024-12-20T22:40:30.666ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102122024-12-20T22:40:30.668ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102132024-12-20T22:40:30.675ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
102142024-12-20T22:40:30.675ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102152024-12-20T22:40:30.676ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102162024-12-20T22:40:30.676ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "928d29bd-b3f5-4c11-848f-cad2470df8ea", "content-length": "26", "date": "Fri, 20 Dec 2024 22:40:30 GMT"} })
102172024-12-20T22:40:30.676ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102182024-12-20T22:40:30.678ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102192024-12-20T22:40:30.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
102202024-12-20T22:40:30.680ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102212024-12-20T22:40:30.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102222024-12-20T22:40:30.681ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 107.845316ms iteration = 30 status = 0
102232024-12-20T22:40:30.682ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 108.217346ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
102242024-12-20T22:40:30.689ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 zone_address = fd00:1122:3344:101::2
102252024-12-20T22:40:30.689ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102262024-12-20T22:40:30.689ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "26d3ee64-2911-4445-9cf8-d7bad4689839", "content-length": "26", "date": "Fri, 20 Dec 2024 22:40:30 GMT"} })
102272024-12-20T22:40:30.689ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102282024-12-20T22:40:30.690ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
102292024-12-20T22:40:30.696ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 122.112019ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
102302024-12-20T22:40:30.701ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102312024-12-20T22:40:30.701ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
102322024-12-20T22:40:30.701ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 127.17789ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
102332024-12-20T22:40:30.750ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102342024-12-20T22:40:30.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102352024-12-20T22:40:30.766ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 194.831137ms iteration = 30 status = {}
102362024-12-20T22:40:30.777ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
102372024-12-20T22:40:30.777ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa6c2494-ba7d-4cfa-b6e2-03526a17cb05", "content-length": "2", "date": "Fri, 20 Dec 2024 22:40:30 GMT"} })
102382024-12-20T22:40:30.778ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
102392024-12-20T22:40:30.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
102402024-12-20T22:40:30.796ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
102412024-12-20T22:40:30.796ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102422024-12-20T22:40:30.796ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb816461-2f14-4761-865f-451011ddf69b", "content-length": "372", "date": "Fri, 20 Dec 2024 22:40:29 GMT"} })
102432024-12-20T22:40:30.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102442024-12-20T22:40:30.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102452024-12-20T22:40:30.797ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102462024-12-20T22:40:30.798ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 226.746028ms iteration = 30 status = null
102472024-12-20T22:40:30.799ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102482024-12-20T22:40:30.799ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102492024-12-20T22:40:30.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102502024-12-20T22:40:30.837ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102512024-12-20T22:40:30.839ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102522024-12-20T22:40:30.839ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102532024-12-20T22:40:30.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102542024-12-20T22:40:30.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102552024-12-20T22:40:30.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102562024-12-20T22:40:30.847ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9fedf0d4-8a86-4506-bf93-224faabd5e37, rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b26f0563-25fb-4d7c-8480-dd368ac01105) } rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
102572024-12-20T22:40:30.847ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102582024-12-20T22:40:30.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102592024-12-20T22:40:30.851ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
102602024-12-20T22:40:30.851ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
102612024-12-20T22:40:30.851ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3debddb9-0f86-4ab1-9e3c-652acb37f680", "date": "Fri, 20 Dec 2024 22:40:30 GMT"} })
102622024-12-20T22:40:30.851ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102632024-12-20T22:40:30.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102642024-12-20T22:40:30.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102652024-12-20T22:40:30.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102662024-12-20T22:40:30.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102672024-12-20T22:40:30.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102682024-12-20T22:40:30.857ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
102692024-12-20T22:40:30.858ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "30901c0e-0214-4545-b759-39d615dad7b6", "content-length": "134", "date": "Fri, 20 Dec 2024 22:40:30 GMT"} })
102702024-12-20T22:40:30.858ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
102712024-12-20T22:40:30.858ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b26f0563-25fb-4d7c-8480-dd368ac01105
102722024-12-20T22:40:30.858ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
102732024-12-20T22:40:30.858ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
102742024-12-20T22:40:30.858ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102752024-12-20T22:40:30.858ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102762024-12-20T22:40:30.858ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102772024-12-20T22:40:30.858ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
102782024-12-20T22:40:30.858ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102792024-12-20T22:40:30.858ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
102802024-12-20T22:40:30.858ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
102812024-12-20T22:40:30.858ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102822024-12-20T22:40:30.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102832024-12-20T22:40:30.859ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
102842024-12-20T22:40:30.859ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102852024-12-20T22:40:30.860ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bf9acccb-4f65-484a-97bf-4e222beeccdb", "date": "Fri, 20 Dec 2024 22:40:30 GMT"} })
102862024-12-20T22:40:30.861ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
102872024-12-20T22:40:30.861ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "51d91fcf-e4e5-4d74-b5a0-b71661d59fc7", "content-length": "2", "date": "Fri, 20 Dec 2024 22:40:30 GMT"} })
102882024-12-20T22:40:30.861ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
102892024-12-20T22:40:30.862ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1a2d164-acb8-4519-9112-e4ea57c5185d", "content-length": "52", "date": "Fri, 20 Dec 2024 22:40:30 GMT"} })
102902024-12-20T22:40:30.862ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
102912024-12-20T22:40:30.862ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
102922024-12-20T22:40:30.865ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 291.760482ms iteration = 31 status = {}
102932024-12-20T22:40:30.963ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
102942024-12-20T22:40:30.968ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4900e794-7c6d-4e20-8217-ec4e3bb78f6e", "date": "Fri, 20 Dec 2024 22:40:30 GMT"} })
102952024-12-20T22:40:30.968ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch = Switch0
102962024-12-20T22:40:30.968ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
102972024-12-20T22:40:30.968ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "aae85649-dd6f-4e64-bcdc-b7305bb66523", "content-length": "682", "date": "Fri, 20 Dec 2024 22:40:30 GMT"} })
102982024-12-20T22:40:30.969ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102992024-12-20T22:40:30.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103002024-12-20T22:40:30.969ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f99b88d3-0525-485b-96b0-1301911f186b", "content-length": "691", "date": "Fri, 20 Dec 2024 22:40:30 GMT"} })
103012024-12-20T22:40:30.969ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
103022024-12-20T22:40:30.969ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
103032024-12-20T22:40:30.969ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
103042024-12-20T22:40:30.970ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 396.682447ms iteration = 31 status = {}
103052024-12-20T22:40:30.972ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103062024-12-20T22:40:30.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103072024-12-20T22:40:30.976ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103082024-12-20T22:40:30.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103092024-12-20T22:40:30.978ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103102024-12-20T22:40:30.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103112024-12-20T22:40:30.986ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 412.662937ms iteration = 30 status = {}
103122024-12-20T22:40:31.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = bfd6a4e0-3437-4b5e-8477-949fb356f481 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103132024-12-20T22:40:31.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = bfd6a4e0-3437-4b5e-8477-949fb356f481 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103142024-12-20T22:40:31.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = bfd6a4e0-3437-4b5e-8477-949fb356f481 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103152024-12-20T22:40:32.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0a87080f-5a8a-4993-95d8-1ab7d8a71609 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103162024-12-20T22:40:32.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0a87080f-5a8a-4993-95d8-1ab7d8a71609 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103172024-12-20T22:40:32.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2747 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0a87080f-5a8a-4993-95d8-1ab7d8a71609 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103182024-12-20T22:40:33.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ba9e8324-cb52-4387-8c21-5c98b161de3b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103192024-12-20T22:40:33.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ba9e8324-cb52-4387-8c21-5c98b161de3b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103202024-12-20T22:40:33.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2850 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ba9e8324-cb52-4387-8c21-5c98b161de3b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103212024-12-20T22:40:34.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 86988edc-2b83-423c-aa05-b09b87d9095d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103222024-12-20T22:40:34.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 86988edc-2b83-423c-aa05-b09b87d9095d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103232024-12-20T22:40:34.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2572 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 86988edc-2b83-423c-aa05-b09b87d9095d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103242024-12-20T22:40:35.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 700 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 626e14b0-fb1f-45c4-aa0f-b2748793161c response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
103252024-12-20T22:40:35.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fd58cbe4-341d-4ddd-a332-392714d9507c roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103262024-12-20T22:40:35.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fd58cbe4-341d-4ddd-a332-392714d9507c resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103272024-12-20T22:40:35.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2978 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = fd58cbe4-341d-4ddd-a332-392714d9507c response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103282024-12-20T22:40:36.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 44df95be-1371-4960-979e-65e05301b79e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103292024-12-20T22:40:36.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 44df95be-1371-4960-979e-65e05301b79e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103302024-12-20T22:40:36.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 44df95be-1371-4960-979e-65e05301b79e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103312024-12-20T22:40:37.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 4c3c9631-2a71-422f-bdfe-8df278eedf9a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
103322024-12-20T22:40:37.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 4c3c9631-2a71-422f-bdfe-8df278eedf9a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
103332024-12-20T22:40:37.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3615 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 4c3c9631-2a71-422f-bdfe-8df278eedf9a response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
103342024-12-20T22:40:37.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a6bd57ca-d55b-40a6-b3c3-408a280c30df roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103352024-12-20T22:40:37.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a6bd57ca-d55b-40a6-b3c3-408a280c30df resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103362024-12-20T22:40:37.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a6bd57ca-d55b-40a6-b3c3-408a280c30df response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103372024-12-20T22:40:38.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ea577f79-65d3-4ec0-b1f2-3acefe06f9c0 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103382024-12-20T22:40:38.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ea577f79-65d3-4ec0-b1f2-3acefe06f9c0 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103392024-12-20T22:40:38.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = ea577f79-65d3-4ec0-b1f2-3acefe06f9c0 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103402024-12-20T22:40:39.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1c93943f-95bc-4a51-9acb-952a12a3b55c roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103412024-12-20T22:40:39.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1c93943f-95bc-4a51-9acb-952a12a3b55c resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103422024-12-20T22:40:39.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2729 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1c93943f-95bc-4a51-9acb-952a12a3b55c response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103432024-12-20T22:40:40.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
103442024-12-20T22:40:40.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103452024-12-20T22:40:40.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103462024-12-20T22:40:40.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
103472024-12-20T22:40:40.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103482024-12-20T22:40:40.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103492024-12-20T22:40:40.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103502024-12-20T22:40:40.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
103512024-12-20T22:40:40.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103522024-12-20T22:40:40.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103532024-12-20T22:40:40.619ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103542024-12-20T22:40:40.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103552024-12-20T22:40:40.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103562024-12-20T22:40:40.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103572024-12-20T22:40:40.657ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 84.338087ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103582024-12-20T22:40:40.662ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103592024-12-20T22:40:40.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
103602024-12-20T22:40:40.665ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103612024-12-20T22:40:40.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103622024-12-20T22:40:40.677ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
103632024-12-20T22:40:40.677ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 104.980797ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
103642024-12-20T22:40:40.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a2d69e0a-4428-4905-aebb-f857a544c7ce roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103652024-12-20T22:40:40.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a2d69e0a-4428-4905-aebb-f857a544c7ce resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103662024-12-20T22:40:40.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a2d69e0a-4428-4905-aebb-f857a544c7ce response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103672024-12-20T22:40:41.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 749a1074-86fb-449a-8319-d8039cb47201 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103682024-12-20T22:40:41.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 749a1074-86fb-449a-8319-d8039cb47201 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103692024-12-20T22:40:41.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 749a1074-86fb-449a-8319-d8039cb47201 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103702024-12-20T22:40:42.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6c14d6cf-664a-42b8-b16f-a909403c270d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103712024-12-20T22:40:42.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6c14d6cf-664a-42b8-b16f-a909403c270d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103722024-12-20T22:40:42.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 6c14d6cf-664a-42b8-b16f-a909403c270d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103732024-12-20T22:40:43.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 00895453-6949-4e13-a52a-3b088f34bb88 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103742024-12-20T22:40:43.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 00895453-6949-4e13-a52a-3b088f34bb88 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103752024-12-20T22:40:43.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 00895453-6949-4e13-a52a-3b088f34bb88 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103762024-12-20T22:40:44.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 43eced59-5bea-4630-884d-1df116df2dc1 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103772024-12-20T22:40:44.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 43eced59-5bea-4630-884d-1df116df2dc1 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103782024-12-20T22:40:44.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2114 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 43eced59-5bea-4630-884d-1df116df2dc1 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103792024-12-20T22:40:45.328ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 852 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 4b3063bd-7a83-452f-856b-6e3553eb7f9e response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
103802024-12-20T22:40:45.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c432a921-6af9-4cf6-9775-9df01db076c2 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103812024-12-20T22:40:45.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c432a921-6af9-4cf6-9775-9df01db076c2 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103822024-12-20T22:40:45.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c432a921-6af9-4cf6-9775-9df01db076c2 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103832024-12-20T22:40:46.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1d771bfa-0bd3-4e81-8901-ab74a938f163 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103842024-12-20T22:40:46.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1d771bfa-0bd3-4e81-8901-ab74a938f163 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103852024-12-20T22:40:46.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1d771bfa-0bd3-4e81-8901-ab74a938f163 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103862024-12-20T22:40:47.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0b073905-94af-4e89-ac01-018bcdad1dce roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103872024-12-20T22:40:47.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0b073905-94af-4e89-ac01-018bcdad1dce resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103882024-12-20T22:40:47.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0b073905-94af-4e89-ac01-018bcdad1dce response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103892024-12-20T22:40:48.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 01f7cff0-2856-455d-8e7e-e95710e96d6b roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103902024-12-20T22:40:48.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 01f7cff0-2856-455d-8e7e-e95710e96d6b resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103912024-12-20T22:40:48.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 01f7cff0-2856-455d-8e7e-e95710e96d6b response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103922024-12-20T22:40:49.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2a34252c-1385-402e-bfa5-65970380cc21 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103932024-12-20T22:40:49.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2a34252c-1385-402e-bfa5-65970380cc21 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103942024-12-20T22:40:49.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 2a34252c-1385-402e-bfa5-65970380cc21 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
103952024-12-20T22:40:50.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
103962024-12-20T22:40:50.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103972024-12-20T22:40:50.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103982024-12-20T22:40:50.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
103992024-12-20T22:40:50.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104002024-12-20T22:40:50.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104012024-12-20T22:40:50.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104022024-12-20T22:40:50.615ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104032024-12-20T22:40:50.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104042024-12-20T22:40:50.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104052024-12-20T22:40:50.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104062024-12-20T22:40:50.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104072024-12-20T22:40:50.617ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 44.133388ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104082024-12-20T22:40:50.619ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104092024-12-20T22:40:50.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104102024-12-20T22:40:50.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104112024-12-20T22:40:50.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
104122024-12-20T22:40:50.623ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104132024-12-20T22:40:50.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104142024-12-20T22:40:50.634ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
104152024-12-20T22:40:50.634ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 62.803143ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
104162024-12-20T22:40:50.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4e712fcf-4f33-47a4-a6e1-70ee14416545 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104172024-12-20T22:40:50.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4e712fcf-4f33-47a4-a6e1-70ee14416545 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104182024-12-20T22:40:50.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4e712fcf-4f33-47a4-a6e1-70ee14416545 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104192024-12-20T22:40:51.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 76c6ad1f-1205-4fc9-9ee0-fa2ee3b3ad2e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104202024-12-20T22:40:51.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 76c6ad1f-1205-4fc9-9ee0-fa2ee3b3ad2e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104212024-12-20T22:40:51.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 76c6ad1f-1205-4fc9-9ee0-fa2ee3b3ad2e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104222024-12-20T22:40:52.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 88ddb723-dc86-42dd-9d22-fc323c289566 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104232024-12-20T22:40:52.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 88ddb723-dc86-42dd-9d22-fc323c289566 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104242024-12-20T22:40:52.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 88ddb723-dc86-42dd-9d22-fc323c289566 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104252024-12-20T22:40:53.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a8c413ee-6e0c-4911-adc9-692e5d76c52f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104262024-12-20T22:40:53.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a8c413ee-6e0c-4911-adc9-692e5d76c52f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104272024-12-20T22:40:53.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1936 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a8c413ee-6e0c-4911-adc9-692e5d76c52f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104282024-12-20T22:40:54.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a3474807-df48-49fe-92cf-02d45e0f8f1f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104292024-12-20T22:40:54.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a3474807-df48-49fe-92cf-02d45e0f8f1f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104302024-12-20T22:40:55.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a3474807-df48-49fe-92cf-02d45e0f8f1f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104312024-12-20T22:40:55.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 882 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 32d2b6b4-bc69-4864-998c-5701218b9b1a response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
104322024-12-20T22:40:56.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a7ed6823-0759-4aa7-87d1-e43c2ac90023 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104332024-12-20T22:40:56.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a7ed6823-0759-4aa7-87d1-e43c2ac90023 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104342024-12-20T22:40:56.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a7ed6823-0759-4aa7-87d1-e43c2ac90023 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104352024-12-20T22:40:57.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e56554ce-26fe-4cc6-9aa0-584d19bc28ff roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104362024-12-20T22:40:57.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e56554ce-26fe-4cc6-9aa0-584d19bc28ff resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104372024-12-20T22:40:57.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e56554ce-26fe-4cc6-9aa0-584d19bc28ff response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104382024-12-20T22:40:58.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9e13ce7d-dfd8-4d8d-b4a8-f295b901bc38 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104392024-12-20T22:40:58.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9e13ce7d-dfd8-4d8d-b4a8-f295b901bc38 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104402024-12-20T22:40:58.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9e13ce7d-dfd8-4d8d-b4a8-f295b901bc38 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104412024-12-20T22:40:59.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4e7cea38-438e-4864-9bc7-a10d1f3b7060 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104422024-12-20T22:40:59.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4e7cea38-438e-4864-9bc7-a10d1f3b7060 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104432024-12-20T22:40:59.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4e7cea38-438e-4864-9bc7-a10d1f3b7060 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104442024-12-20T22:41:00.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5cb617f0-cc96-4cf6-9f48-0edb6a38c9ba roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104452024-12-20T22:41:00.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5cb617f0-cc96-4cf6-9f48-0edb6a38c9ba resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104462024-12-20T22:41:00.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2557 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5cb617f0-cc96-4cf6-9f48-0edb6a38c9ba response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
104472024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 31 reason = Timeout
104482024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
104492024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 31 reason = Timeout
104502024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
104512024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
104522024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 31 reason = Timeout
104532024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 18 reason = Timeout
104542024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
104552024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
104562024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104572024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 16 reason = Timeout
104582024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
104592024-12-20T22:41:00.571ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-20 22:31:00.571181715 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
104602024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 18 reason = Timeout
104612024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
104622024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
104632024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104642024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
104652024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
104662024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
104672024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
104682024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
104692024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
104702024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104712024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
104722024-12-20T22:41:00.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
104732024-12-20T22:41:00.571ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6b172144-6fe3-403a-b88e-6be93db6788c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e1e925bb-4266-49d2-b532-0f79860badbb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e9d7e78a-d944-4f23-9be0-86e0f1334a43.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e9d7e78a-d944-4f23-9be0-86e0f1334a43.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1608, tv_nsec: 184041061 } })
104742024-12-20T22:41:00.571ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9bcf7579-f08c-458a-b8fa-486beafab77e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c65750e1-e505-4d05-b242-145c69974016.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c65750e1-e505-4d05-b242-145c69974016.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1608, tv_nsec: 184139793 } })
104752024-12-20T22:41:00.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 91 reason = Timeout
104762024-12-20T22:41:00.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 17 reason = Timeout
104772024-12-20T22:41:00.572ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e
104782024-12-20T22:41:00.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104792024-12-20T22:41:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.091\u{b5}s iteration = 17 status = {"enabled":false,"target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e"}
104802024-12-20T22:41:00.572ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
104812024-12-20T22:41:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.09546ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
104822024-12-20T22:41:00.572ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
104832024-12-20T22:41:00.572ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.232584ms iteration = 16 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
104842024-12-20T22:41:00.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104852024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 91 reason = Timeout
104862024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
104872024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104882024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104892024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 16 reason = Timeout
104902024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
104912024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 4 reason = Timeout
104922024-12-20T22:41:00.573ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
104932024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
104942024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 16 reason = Timeout
104952024-12-20T22:41:00.573ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
104962024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 31 reason = Timeout
104972024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
104982024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
104992024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 16 reason = Timeout
105002024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
105012024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 31 reason = Timeout
105022024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
105032024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 31 reason = Timeout
105042024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
105052024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 31 reason = Timeout
105062024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
105072024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 7 reason = Timeout
105082024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 16 reason = Timeout
105092024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
105102024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
105112024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 31 reason = Timeout
105122024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
105132024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 32 reason = Timeout
105142024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105152024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 31 reason = Timeout
105162024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
105172024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
105182024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105192024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
105202024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105212024-12-20T22:41:00.573ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
105222024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105232024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 31 reason = Timeout
105242024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105252024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 31 reason = Timeout
105262024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105272024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105282024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105292024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
105302024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
105312024-12-20T22:41:00.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
105322024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
105332024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
105342024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105352024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
105362024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105372024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
105382024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105392024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105402024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105412024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
105422024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105432024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
105442024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
105452024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105462024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105472024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105482024-12-20T22:41:00.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1608, tv_nsec: 186571791 } })
105492024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
105502024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
105512024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105522024-12-20T22:41:00.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
105532024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
105542024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
105552024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105562024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
105572024-12-20T22:41:00.574ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
105582024-12-20T22:41:00.575ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1608, tv_nsec: 187367433 } })
105592024-12-20T22:41:00.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105602024-12-20T22:41:00.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
105612024-12-20T22:41:00.575ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.031821ms iteration = 31 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
105622024-12-20T22:41:00.575ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105632024-12-20T22:41:00.575ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
105642024-12-20T22:41:00.576ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-20 22:31:00.571181715 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
105652024-12-20T22:41:00.576ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.505962ms iteration = 16 status = {"expiration":"2024-12-20T22:31:00.571181715Z","pruned":[]}
105662024-12-20T22:41:00.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105672024-12-20T22:41:00.577ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
105682024-12-20T22:41:00.577ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105692024-12-20T22:41:00.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105702024-12-20T22:41:00.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105712024-12-20T22:41:00.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105722024-12-20T22:41:00.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105732024-12-20T22:41:00.582ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 9.321377ms iteration = 16 status = {"errors":[],"found_port_ok":[]}
105742024-12-20T22:41:00.583ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
105752024-12-20T22:41:00.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
105762024-12-20T22:41:00.638ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105772024-12-20T22:41:00.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
105782024-12-20T22:41:00.642ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105792024-12-20T22:41:00.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105802024-12-20T22:41:00.644ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105812024-12-20T22:41:00.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
105822024-12-20T22:41:00.650ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105832024-12-20T22:41:00.650ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
105842024-12-20T22:41:00.650ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
105852024-12-20T22:41:00.650ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 77.073007ms iteration = 16 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
105862024-12-20T22:41:00.650ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105872024-12-20T22:41:00.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
105882024-12-20T22:41:00.652ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105892024-12-20T22:41:00.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105902024-12-20T22:41:00.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105912024-12-20T22:41:00.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
105922024-12-20T22:41:00.653ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
105932024-12-20T22:41:00.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
105942024-12-20T22:41:00.653ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105952024-12-20T22:41:00.654ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105962024-12-20T22:41:00.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105972024-12-20T22:41:00.656ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
105982024-12-20T22:41:00.656ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
105992024-12-20T22:41:00.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
106002024-12-20T22:41:00.657ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
106012024-12-20T22:41:00.657ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106022024-12-20T22:41:00.657ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106032024-12-20T22:41:00.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106042024-12-20T22:41:00.658ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106052024-12-20T22:41:00.659ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106062024-12-20T22:41:00.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
106072024-12-20T22:41:00.661ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
106082024-12-20T22:41:00.661ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
106092024-12-20T22:41:00.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
106102024-12-20T22:41:00.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106112024-12-20T22:41:00.663ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106122024-12-20T22:41:00.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
106132024-12-20T22:41:00.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
106142024-12-20T22:41:00.663ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
106152024-12-20T22:41:00.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106162024-12-20T22:41:00.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
106172024-12-20T22:41:00.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 90.610881ms iteration = 31 status = {"errors":[],"finish_invoked_ok":[]}
106182024-12-20T22:41:00.664ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106192024-12-20T22:41:00.665ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-60382741-4b2a-4c29-94f6-25f67f5ab7e4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1608, tv_nsec: 277693185 } })
106202024-12-20T22:41:00.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
106212024-12-20T22:41:00.665ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
106222024-12-20T22:41:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
106232024-12-20T22:41:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
106242024-12-20T22:41:00.666ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
106252024-12-20T22:41:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
106262024-12-20T22:41:00.666ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 93.50227ms iteration = 31 status = {"errors":[],"garbage_collect_requested":[]}
106272024-12-20T22:41:00.666ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106282024-12-20T22:41:00.667ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106292024-12-20T22:41:00.667ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
106302024-12-20T22:41:00.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106312024-12-20T22:41:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106322024-12-20T22:41:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106332024-12-20T22:41:00.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106342024-12-20T22:41:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106352024-12-20T22:41:00.668ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106362024-12-20T22:41:00.668ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106372024-12-20T22:41:00.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106382024-12-20T22:41:00.669ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106392024-12-20T22:41:00.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106402024-12-20T22:41:00.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
106412024-12-20T22:41:00.670ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
106422024-12-20T22:41:00.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
106432024-12-20T22:41:00.671ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106442024-12-20T22:41:00.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106452024-12-20T22:41:00.673ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 100.292857ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
106462024-12-20T22:41:00.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106472024-12-20T22:41:00.676ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106482024-12-20T22:41:00.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106492024-12-20T22:41:00.676ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106502024-12-20T22:41:00.676ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
106512024-12-20T22:41:00.676ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106522024-12-20T22:41:00.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106532024-12-20T22:41:00.677ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106542024-12-20T22:41:00.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
106552024-12-20T22:41:00.678ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106562024-12-20T22:41:00.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106572024-12-20T22:41:00.680ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106582024-12-20T22:41:00.680ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106592024-12-20T22:41:00.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106602024-12-20T22:41:00.682ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
106612024-12-20T22:41:00.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
106622024-12-20T22:41:00.688ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106632024-12-20T22:41:00.691ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106642024-12-20T22:41:00.691ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106652024-12-20T22:41:00.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106662024-12-20T22:41:00.703ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
106672024-12-20T22:41:00.703ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
106682024-12-20T22:41:00.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
106692024-12-20T22:41:00.709ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
106702024-12-20T22:41:00.709ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 137.464003ms iteration = 91 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
106712024-12-20T22:41:00.719ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
106722024-12-20T22:41:00.719ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
106732024-12-20T22:41:00.719ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
106742024-12-20T22:41:00.719ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106752024-12-20T22:41:00.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106762024-12-20T22:41:00.720ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106772024-12-20T22:41:00.720ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106782024-12-20T22:41:00.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106792024-12-20T22:41:00.722ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106802024-12-20T22:41:00.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
106812024-12-20T22:41:00.722ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
106822024-12-20T22:41:00.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
106832024-12-20T22:41:00.725ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106842024-12-20T22:41:00.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106852024-12-20T22:41:00.726ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
106862024-12-20T22:41:00.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106872024-12-20T22:41:00.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106882024-12-20T22:41:00.728ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 155.318916ms iteration = 7 status = {"nsuccess":5}
106892024-12-20T22:41:00.728ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106902024-12-20T22:41:00.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
106912024-12-20T22:41:00.731ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106922024-12-20T22:41:00.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106932024-12-20T22:41:00.733ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
106942024-12-20T22:41:00.733ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
106952024-12-20T22:41:00.733ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
106962024-12-20T22:41:00.733ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106972024-12-20T22:41:00.733ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
106982024-12-20T22:41:00.733ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
106992024-12-20T22:41:00.733ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 160.028356ms iteration = 16 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
107002024-12-20T22:41:00.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107012024-12-20T22:41:00.734ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
107022024-12-20T22:41:00.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107032024-12-20T22:41:00.735ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107042024-12-20T22:41:00.736ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 163.106581ms iteration = 31 status = 0
107052024-12-20T22:41:00.738ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
107062024-12-20T22:41:00.738ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
107072024-12-20T22:41:00.738ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107082024-12-20T22:41:00.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107092024-12-20T22:41:00.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
107102024-12-20T22:41:00.739ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107112024-12-20T22:41:00.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107122024-12-20T22:41:00.740ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107132024-12-20T22:41:00.740ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107142024-12-20T22:41:00.741ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
107152024-12-20T22:41:00.741ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 0 version = 2
107162024-12-20T22:41:00.741ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107172024-12-20T22:41:00.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107182024-12-20T22:41:00.743ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 169.621171ms iteration = 91 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
107192024-12-20T22:41:00.743ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107202024-12-20T22:41:00.743ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
107212024-12-20T22:41:00.743ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 169.96588ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
107222024-12-20T22:41:00.743ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107232024-12-20T22:41:00.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
107242024-12-20T22:41:00.743ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107252024-12-20T22:41:00.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107262024-12-20T22:41:00.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
107272024-12-20T22:41:00.744ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
107282024-12-20T22:41:00.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
107292024-12-20T22:41:00.744ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107302024-12-20T22:41:00.745ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
107312024-12-20T22:41:00.745ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 171.732829ms iteration = 31 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
107322024-12-20T22:41:00.745ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107332024-12-20T22:41:00.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107342024-12-20T22:41:00.746ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 584d4c53-9404-4315-8b3f-05f564cd69ee dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
107352024-12-20T22:41:00.746ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
107362024-12-20T22:41:00.746ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-20 22:26:39.700273 UTC dns_group = internal generation = 1
107372024-12-20T22:41:00.746ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 175.061031ms iteration = 16 status = {"generation":1}
107382024-12-20T22:41:00.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
107392024-12-20T22:41:00.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
107402024-12-20T22:41:00.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
107412024-12-20T22:41:00.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
107422024-12-20T22:41:00.747ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107432024-12-20T22:41:00.747ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107442024-12-20T22:41:00.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107452024-12-20T22:41:00.749ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f06e67c8-b549-4506-8b1d-c89671ced3a3 dns_zone_name = oxide.test found_so_far = 1 version = 2
107462024-12-20T22:41:00.749ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
107472024-12-20T22:41:00.749ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-20 22:26:40.428768 UTC dns_group = external generation = 2
107482024-12-20T22:41:00.749ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 177.835158ms iteration = 16 status = {"generation":2}
107492024-12-20T22:41:00.749ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107502024-12-20T22:41:00.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107512024-12-20T22:41:00.749ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
107522024-12-20T22:41:00.749ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
107532024-12-20T22:41:00.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
107542024-12-20T22:41:00.751ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 177.651562ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
107552024-12-20T22:41:00.751ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107562024-12-20T22:41:00.751ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
107572024-12-20T22:41:00.751ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107582024-12-20T22:41:00.751ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "983b31c8-8e1e-4461-b2a6-edc556eb9d53", "content-length": "26", "date": "Fri, 20 Dec 2024 22:41:00 GMT"} })
107592024-12-20T22:41:00.751ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107602024-12-20T22:41:00.753ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
107612024-12-20T22:41:00.755ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
107622024-12-20T22:41:00.755ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107632024-12-20T22:41:00.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107642024-12-20T22:41:00.756ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107652024-12-20T22:41:00.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107662024-12-20T22:41:00.757ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107672024-12-20T22:41:00.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107682024-12-20T22:41:00.759ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107692024-12-20T22:41:00.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
107702024-12-20T22:41:00.762ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107712024-12-20T22:41:00.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107722024-12-20T22:41:00.764ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107732024-12-20T22:41:00.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107742024-12-20T22:41:00.765ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107752024-12-20T22:41:00.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107762024-12-20T22:41:00.768ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107772024-12-20T22:41:00.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107782024-12-20T22:41:00.770ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107792024-12-20T22:41:00.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107802024-12-20T22:41:00.771ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107812024-12-20T22:41:00.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107822024-12-20T22:41:00.777ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107832024-12-20T22:41:00.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107842024-12-20T22:41:00.778ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
107852024-12-20T22:41:00.779ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107862024-12-20T22:41:00.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
107872024-12-20T22:41:00.782ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107882024-12-20T22:41:00.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107892024-12-20T22:41:00.785ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107902024-12-20T22:41:00.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107912024-12-20T22:41:00.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 211.847616ms iteration = 31 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
107922024-12-20T22:41:00.787ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107932024-12-20T22:41:00.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107942024-12-20T22:41:00.789ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107952024-12-20T22:41:00.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107962024-12-20T22:41:00.789ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107972024-12-20T22:41:00.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
107982024-12-20T22:41:00.791ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
107992024-12-20T22:41:00.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108002024-12-20T22:41:00.793ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108012024-12-20T22:41:00.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108022024-12-20T22:41:00.794ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108032024-12-20T22:41:00.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108042024-12-20T22:41:00.796ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108052024-12-20T22:41:00.798ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108062024-12-20T22:41:00.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108072024-12-20T22:41:00.799ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
108082024-12-20T22:41:00.799ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108092024-12-20T22:41:00.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108102024-12-20T22:41:00.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108112024-12-20T22:41:00.801ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108122024-12-20T22:41:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108132024-12-20T22:41:00.803ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
108142024-12-20T22:41:00.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108152024-12-20T22:41:00.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108162024-12-20T22:41:00.809ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-20T22:25:57.040586Z, time_modified: 2024-12-20T22:25:57.040586Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: e1a624a4-dfde-423b-a38d-470dfb011cc3, db_silo: Silo { identity: SiloIdentity { id: e1a624a4-dfde-423b-a38d-470dfb011cc3, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-20T22:26:40.343182Z, time_modified: 2024-12-20T22:26:40.343182Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481" }] }) }
108172024-12-20T22:41:00.809ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 238.571674ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]}},"default_endpoint":{"silo_id":"e1a624a4-dfde-423b-a38d-470dfb011cc3","tls_certs":["75a843f44a47a5140bb5c209bf61286682baaecf62d5c8a5e5bfb462dacc9481"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
108182024-12-20T22:41:00.839ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
108192024-12-20T22:41:00.839ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 266.319779ms iteration = 16 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
108202024-12-20T22:41:00.870ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 296.805971ms iteration = 34 status = {"physical_disks_added":0}
108212024-12-20T22:41:00.870ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
108222024-12-20T22:41:00.870ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108232024-12-20T22:41:00.871ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa59582d-e4f2-40cd-a4c3-e6fcf014119d", "content-length": "26", "date": "Fri, 20 Dec 2024 22:41:00 GMT"} })
108242024-12-20T22:41:00.871ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108252024-12-20T22:41:00.873ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 zone_address = fd00:1122:3344:101::2
108262024-12-20T22:41:00.873ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108272024-12-20T22:41:00.873ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
108282024-12-20T22:41:00.873ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9bb1d9e-fea7-474d-9689-3640b4d38aa8", "content-length": "26", "date": "Fri, 20 Dec 2024 22:41:00 GMT"} })
108292024-12-20T22:41:00.873ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108302024-12-20T22:41:00.875ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
108312024-12-20T22:41:00.883ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
108322024-12-20T22:41:00.962ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
108332024-12-20T22:41:00.962ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
108342024-12-20T22:41:00.962ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d301b645-e939-427b-aab9-5a389b8ba4b9", "content-length": "372", "date": "Fri, 20 Dec 2024 22:41:00 GMT"} })
108352024-12-20T22:41:00.962ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108362024-12-20T22:41:00.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108372024-12-20T22:41:00.963ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 392.271405ms iteration = 31 status = {}
108382024-12-20T22:41:00.963ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108392024-12-20T22:41:00.966ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
108402024-12-20T22:41:00.966ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108412024-12-20T22:41:00.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108422024-12-20T22:41:01.011ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108432024-12-20T22:41:01.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108442024-12-20T22:41:01.013ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108452024-12-20T22:41:01.016ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
108462024-12-20T22:41:01.017ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2a3b10a-0014-4fd0-80d6-61b98b20597c", "content-length": "2", "date": "Fri, 20 Dec 2024 22:41:00 GMT"} })
108472024-12-20T22:41:01.017ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
108482024-12-20T22:41:01.017ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108492024-12-20T22:41:01.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108502024-12-20T22:41:01.018ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
108512024-12-20T22:41:01.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
108522024-12-20T22:41:01.020ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 449.911476ms iteration = 31 status = null
108532024-12-20T22:41:01.023ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108542024-12-20T22:41:01.023ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
108552024-12-20T22:41:01.023ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
108562024-12-20T22:41:01.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108572024-12-20T22:41:01.023ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
108582024-12-20T22:41:01.023ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "04d3ba8d-218d-4e78-b8c5-54ce5035ee00", "date": "Fri, 20 Dec 2024 22:41:00 GMT"} })
108592024-12-20T22:41:01.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108602024-12-20T22:41:01.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108612024-12-20T22:41:01.023ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a5fb3d74-c961-4481-a0d7-2569e8870b3e", "date": "Fri, 20 Dec 2024 22:41:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108622024-12-20T22:41:01.023ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108632024-12-20T22:41:01.025ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108642024-12-20T22:41:01.025ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "513966af-6776-44c9-bdc8-0e4f2f3d9536", "date": "Fri, 20 Dec 2024 22:41:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108652024-12-20T22:41:01.025ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108662024-12-20T22:41:01.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108672024-12-20T22:41:01.026ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108682024-12-20T22:41:01.026ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "33e7ca8f-aa50-49f9-bc19-fab11f254275", "date": "Fri, 20 Dec 2024 22:41:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108692024-12-20T22:41:01.026ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108702024-12-20T22:41:01.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108712024-12-20T22:41:01.026ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108722024-12-20T22:41:01.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108732024-12-20T22:41:01.028ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108742024-12-20T22:41:01.028ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
108752024-12-20T22:41:01.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108762024-12-20T22:41:01.028ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
108772024-12-20T22:41:01.028ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 457.574217ms iteration = 18 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
108782024-12-20T22:41:01.028ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4378f074-e82e-4d58-992e-a774bf67fd18", "date": "Fri, 20 Dec 2024 22:41:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108792024-12-20T22:41:01.028ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108802024-12-20T22:41:01.029ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108812024-12-20T22:41:01.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108822024-12-20T22:41:01.030ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108832024-12-20T22:41:01.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108842024-12-20T22:41:01.031ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f168cef4-0ef8-4e76-947f-96b6bc4207e9", "date": "Fri, 20 Dec 2024 22:41:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108852024-12-20T22:41:01.031ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108862024-12-20T22:41:01.032ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108872024-12-20T22:41:01.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108882024-12-20T22:41:01.032ZINFOnexus (BackgroundTasks): VPC route manager sled 60382741-4b2a-4c29-94f6-25f67f5ab7e4 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
108892024-12-20T22:41:01.032ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
108902024-12-20T22:41:01.033ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "842b8a06-ed0c-40f0-bc88-8e2f9d0bf56b", "date": "Fri, 20 Dec 2024 22:41:00 GMT"} })
108912024-12-20T22:41:01.033ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
108922024-12-20T22:41:01.033ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 462.286998ms iteration = 18 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
108932024-12-20T22:41:01.033ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108942024-12-20T22:41:01.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
108952024-12-20T22:41:01.034ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 461.262629ms iteration = 32 status = {}
108962024-12-20T22:41:01.035ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108972024-12-20T22:41:01.039ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
108982024-12-20T22:41:01.039ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
108992024-12-20T22:41:01.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109002024-12-20T22:41:01.040ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109012024-12-20T22:41:01.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109022024-12-20T22:41:01.042ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109032024-12-20T22:41:01.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109042024-12-20T22:41:01.043ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109052024-12-20T22:41:01.046ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
109062024-12-20T22:41:01.046ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109072024-12-20T22:41:01.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109082024-12-20T22:41:01.053ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 753bd9a0-35c0-4591-b136-cfc90d2d7d2f, kind: Service { id: c65750e1-e505-4d05-b242-145c69974016 }, name: Name("external-dns-c65750e1-e505-4d05-b242-145c69974016"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c5f51553-50ea-408f-ac16-b1e53e3102de, kind: Service { id: 9bcf7579-f08c-458a-b8fa-486beafab77e }, name: Name("external-dns-9bcf7579-f08c-458a-b8fa-486beafab77e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 93])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 7db65b4a-d789-43c3-984f-c485a4e2a375, kind: Service { id: c08fb79e-9df2-49bb-be41-3925df103e75 }, name: Name("nexus-c08fb79e-9df2-49bb-be41-3925df103e75"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b363f91f-4d69-4910-94ae-1db154f74729, kind: Service { id: 6f9920e4-f78b-446d-a886-f757caf64a7f }, name: Name("nexus-6f9920e4-f78b-446d-a886-f757caf64a7f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 70])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d90729b8-5bad-445f-b9c0-90b3d17d83cf, kind: Service { id: d53e973e-73fc-4117-a9f7-47305be7e74c }, name: Name("nexus-d53e973e-73fc-4117-a9f7-47305be7e74c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
109092024-12-20T22:41:01.053ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109102024-12-20T22:41:01.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109112024-12-20T22:41:01.054ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109122024-12-20T22:41:01.056ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
109132024-12-20T22:41:01.056ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109142024-12-20T22:41:01.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109152024-12-20T22:41:01.190ZDEBGnexus (BackgroundTasks): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
109162024-12-20T22:41:01.190ZDEBGnexus (BackgroundTasks): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d413e710-9b7b-497d-9279-e736450e16ee", "content-length": "691", "date": "Fri, 20 Dec 2024 22:41:00 GMT"} })
109172024-12-20T22:41:01.190ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
109182024-12-20T22:41:01.190ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
109192024-12-20T22:41:01.190ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
109202024-12-20T22:41:01.191ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
109212024-12-20T22:41:01.191ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 753bd9a0-35c0-4591-b136-cfc90d2d7d2f, kind: Service { id: c65750e1-e505-4d05-b242-145c69974016 }, name: Name("external-dns-c65750e1-e505-4d05-b242-145c69974016"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c5f51553-50ea-408f-ac16-b1e53e3102de, kind: Service { id: 9bcf7579-f08c-458a-b8fa-486beafab77e }, name: Name("external-dns-9bcf7579-f08c-458a-b8fa-486beafab77e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 93])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 7db65b4a-d789-43c3-984f-c485a4e2a375, kind: Service { id: c08fb79e-9df2-49bb-be41-3925df103e75 }, name: Name("nexus-c08fb79e-9df2-49bb-be41-3925df103e75"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b363f91f-4d69-4910-94ae-1db154f74729, kind: Service { id: 6f9920e4-f78b-446d-a886-f757caf64a7f }, name: Name("nexus-6f9920e4-f78b-446d-a886-f757caf64a7f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 70])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d90729b8-5bad-445f-b9c0-90b3d17d83cf, kind: Service { id: d53e973e-73fc-4117-a9f7-47305be7e74c }, name: Name("nexus-d53e973e-73fc-4117-a9f7-47305be7e74c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
109222024-12-20T22:41:01.191ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
109232024-12-20T22:41:01.192ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 619.081445ms iteration = 32 status = {}
109242024-12-20T22:41:01.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 27300604-303d-4e2a-8471-b67d2b42986e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
109252024-12-20T22:41:01.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 27300604-303d-4e2a-8471-b67d2b42986e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
109262024-12-20T22:41:01.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 27300604-303d-4e2a-8471-b67d2b42986e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
109272024-12-20T22:41:01.209ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109282024-12-20T22:41:01.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109292024-12-20T22:41:01.211ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9fedf0d4-8a86-4506-bf93-224faabd5e37, rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(b26f0563-25fb-4d7c-8480-dd368ac01105) } rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
109302024-12-20T22:41:01.211ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109312024-12-20T22:41:01.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109322024-12-20T22:41:01.220ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
109332024-12-20T22:41:01.220ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e887dd06-d703-4404-954c-3ca17535be1b", "content-length": "134", "date": "Fri, 20 Dec 2024 22:41:00 GMT"} })
109342024-12-20T22:41:01.220ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
109352024-12-20T22:41:01.220ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = b26f0563-25fb-4d7c-8480-dd368ac01105
109362024-12-20T22:41:01.221ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
109372024-12-20T22:41:01.221ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
109382024-12-20T22:41:01.221ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109392024-12-20T22:41:01.221ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109402024-12-20T22:41:01.221ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109412024-12-20T22:41:01.221ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
109422024-12-20T22:41:01.221ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109432024-12-20T22:41:01.221ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
109442024-12-20T22:41:01.221ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7
109452024-12-20T22:41:01.221ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109462024-12-20T22:41:01.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109472024-12-20T22:41:01.223ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
109482024-12-20T22:41:01.223ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7e5c6be-c721-403e-8a0a-b468018bd3b9", "content-length": "2", "date": "Fri, 20 Dec 2024 22:41:00 GMT"} })
109492024-12-20T22:41:01.223ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
109502024-12-20T22:41:01.223ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ff117d1-0123-4cdd-a289-5accad438108", "content-length": "52", "date": "Fri, 20 Dec 2024 22:41:00 GMT"} })
109512024-12-20T22:41:01.223ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch_location = Switch0
109522024-12-20T22:41:01.223ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
109532024-12-20T22:41:01.261ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, time_created: 2024-12-20T22:26:35.129481Z, time_modified: 2024-12-20T22:26:35.129481Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 0141a1f8-3d80-4c87-9331-e02657dbaec7, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
109542024-12-20T22:41:01.261ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
109552024-12-20T22:41:01.261ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109562024-12-20T22:41:01.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109572024-12-20T22:41:01.263ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109582024-12-20T22:41:01.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
109592024-12-20T22:41:01.265ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109602024-12-20T22:41:01.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 60382741-4b2a-4c29-94f6-25f67f5ab7e4, lookup_type: ById(60382741-4b2a-4c29-94f6-25f67f5ab7e4) } result = Ok(())
109612024-12-20T22:41:01.298ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
109622024-12-20T22:41:01.316ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2c1f5506-4e47-4086-939f-be69f8688d62", "date": "Fri, 20 Dec 2024 22:41:00 GMT"} })
109632024-12-20T22:41:01.316ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 switch = Switch0
109642024-12-20T22:41:01.316ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
109652024-12-20T22:41:01.317ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 0141a1f8-3d80-4c87-9331-e02657dbaec7 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5db310f-b028-4a31-969e-f29d2ff1a2a0", "content-length": "682", "date": "Fri, 20 Dec 2024 22:41:01 GMT"} })
109662024-12-20T22:41:01.317ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109672024-12-20T22:41:01.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109682024-12-20T22:41:01.317ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 60382741-4b2a-4c29-94f6-25f67f5ab7e4 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "efa2479e-5695-436b-8d4c-ab306fc8b0e3", "date": "Fri, 20 Dec 2024 22:41:00 GMT"} })
109692024-12-20T22:41:01.319ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
109702024-12-20T22:41:01.319ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 745.945316ms
109712024-12-20T22:41:01.319ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 745.957996ms iteration = 4 status = {}
109722024-12-20T22:41:01.321ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109732024-12-20T22:41:01.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109742024-12-20T22:41:01.324ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109752024-12-20T22:41:01.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109762024-12-20T22:41:01.327ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109772024-12-20T22:41:01.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109782024-12-20T22:41:01.334ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 760.710873ms iteration = 31 status = {}
109792024-12-20T22:41:02.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b9c32b81-6b24-4fdb-9823-0f236e2f280e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
109802024-12-20T22:41:02.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b9c32b81-6b24-4fdb-9823-0f236e2f280e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
109812024-12-20T22:41:02.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = b9c32b81-6b24-4fdb-9823-0f236e2f280e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
109822024-12-20T22:41:03.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5d6e7b73-11ad-4d0d-a16b-164b27edb4ef roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
109832024-12-20T22:41:03.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5d6e7b73-11ad-4d0d-a16b-164b27edb4ef resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
109842024-12-20T22:41:03.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5d6e7b73-11ad-4d0d-a16b-164b27edb4ef response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
109852024-12-20T22:41:04.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 09e7b9da-522d-4174-87fb-e4f349e6feba roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
109862024-12-20T22:41:04.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 09e7b9da-522d-4174-87fb-e4f349e6feba resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
109872024-12-20T22:41:04.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2567 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 09e7b9da-522d-4174-87fb-e4f349e6feba response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
109882024-12-20T22:41:05.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5b3fdf9a-d52e-4a1c-a99b-4d011e1aa17d roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
109892024-12-20T22:41:05.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5b3fdf9a-d52e-4a1c-a99b-4d011e1aa17d resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
109902024-12-20T22:41:05.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2788 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 5b3fdf9a-d52e-4a1c-a99b-4d011e1aa17d response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
109912024-12-20T22:41:05.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 584 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = f80b00bb-f481-4746-88de-bb7d9293718d response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
109922024-12-20T22:41:06.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9a651b91-1e5f-4d0b-aa64-2a0da3912da8 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
109932024-12-20T22:41:06.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9a651b91-1e5f-4d0b-aa64-2a0da3912da8 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
109942024-12-20T22:41:06.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 9a651b91-1e5f-4d0b-aa64-2a0da3912da8 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
109952024-12-20T22:41:07.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 395cfd2a-8369-47cd-b39b-3ef9fb3bcdba roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
109962024-12-20T22:41:07.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 395cfd2a-8369-47cd-b39b-3ef9fb3bcdba resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
109972024-12-20T22:41:07.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:33090 req_id = 395cfd2a-8369-47cd-b39b-3ef9fb3bcdba response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
109982024-12-20T22:41:07.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0a1010a3-b559-4ed7-8a91-13d45306e4e4 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
109992024-12-20T22:41:07.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0a1010a3-b559-4ed7-8a91-13d45306e4e4 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110002024-12-20T22:41:07.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0a1010a3-b559-4ed7-8a91-13d45306e4e4 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110012024-12-20T22:41:08.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e52c8417-781b-4e47-a36d-d670105a4494 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110022024-12-20T22:41:08.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e52c8417-781b-4e47-a36d-d670105a4494 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110032024-12-20T22:41:08.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2570 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = e52c8417-781b-4e47-a36d-d670105a4494 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110042024-12-20T22:41:09.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d8e6d9a2-8652-4fc9-88ca-0815f3691c5a roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110052024-12-20T22:41:09.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d8e6d9a2-8652-4fc9-88ca-0815f3691c5a resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110062024-12-20T22:41:09.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d8e6d9a2-8652-4fc9-88ca-0815f3691c5a response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110072024-12-20T22:41:10.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a266c734-ab23-49b7-bee1-4b3b2c4ddbd8 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110082024-12-20T22:41:10.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a266c734-ab23-49b7-bee1-4b3b2c4ddbd8 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110092024-12-20T22:41:10.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = a266c734-ab23-49b7-bee1-4b3b2c4ddbd8 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110102024-12-20T22:41:10.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 92 reason = Timeout
110112024-12-20T22:41:10.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110122024-12-20T22:41:10.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110132024-12-20T22:41:10.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 92 reason = Timeout
110142024-12-20T22:41:10.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110152024-12-20T22:41:10.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110162024-12-20T22:41:10.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110172024-12-20T22:41:10.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110182024-12-20T22:41:10.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110192024-12-20T22:41:10.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
110202024-12-20T22:41:10.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110212024-12-20T22:41:10.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110222024-12-20T22:41:10.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110232024-12-20T22:41:10.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110242024-12-20T22:41:10.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110252024-12-20T22:41:10.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
110262024-12-20T22:41:10.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110272024-12-20T22:41:10.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110282024-12-20T22:41:10.593ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
110292024-12-20T22:41:10.593ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.248746ms iteration = 92 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
110302024-12-20T22:41:10.617ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 44.650992ms iteration = 92 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
110312024-12-20T22:41:11.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d5294e6c-2a6e-42d0-8778-f0555738498f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110322024-12-20T22:41:11.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d5294e6c-2a6e-42d0-8778-f0555738498f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110332024-12-20T22:41:11.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d5294e6c-2a6e-42d0-8778-f0555738498f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110342024-12-20T22:41:12.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 47255c86-6c10-4bd5-ba70-75e5165e0028 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110352024-12-20T22:41:12.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 47255c86-6c10-4bd5-ba70-75e5165e0028 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110362024-12-20T22:41:12.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 47255c86-6c10-4bd5-ba70-75e5165e0028 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110372024-12-20T22:41:13.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0be6c885-d24c-4b56-b099-051564f7b249 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110382024-12-20T22:41:13.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0be6c885-d24c-4b56-b099-051564f7b249 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110392024-12-20T22:41:13.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2493 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 0be6c885-d24c-4b56-b099-051564f7b249 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110402024-12-20T22:41:14.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 008a5838-0404-4014-9237-4a10aa5ede47 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110412024-12-20T22:41:14.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 008a5838-0404-4014-9237-4a10aa5ede47 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110422024-12-20T22:41:14.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 008a5838-0404-4014-9237-4a10aa5ede47 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110432024-12-20T22:41:15.329ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 592 local_addr = [fd00:1122:3344:101::c]:57412 method = GET remote_addr = [fd00:1122:3344:101::d]:44491 req_id = 163c0f02-bf71-497f-baa4-d953209dc22c response_code = 200 uri = /c08fb79e-9df2-49bb-be41-3925df103e75
110442024-12-20T22:41:15.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8286d54f-cf37-4918-9f48-e645bbf35999 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110452024-12-20T22:41:15.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8286d54f-cf37-4918-9f48-e645bbf35999 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110462024-12-20T22:41:15.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 8286d54f-cf37-4918-9f48-e645bbf35999 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110472024-12-20T22:41:16.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 68a3e889-940a-4c59-af52-fb548c9b49f3 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110482024-12-20T22:41:16.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 68a3e889-940a-4c59-af52-fb548c9b49f3 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110492024-12-20T22:41:16.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 68a3e889-940a-4c59-af52-fb548c9b49f3 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110502024-12-20T22:41:17.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 922f60ce-1851-4c2f-8176-9c561f8830bb roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110512024-12-20T22:41:17.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 922f60ce-1851-4c2f-8176-9c561f8830bb resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110522024-12-20T22:41:17.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 922f60ce-1851-4c2f-8176-9c561f8830bb response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110532024-12-20T22:41:18.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1c58e72f-2e46-4553-a2be-2d8bea840925 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110542024-12-20T22:41:18.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1c58e72f-2e46-4553-a2be-2d8bea840925 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110552024-12-20T22:41:18.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 1c58e72f-2e46-4553-a2be-2d8bea840925 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110562024-12-20T22:41:19.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d8d12b9f-c08f-4c13-828b-1e9c7c00a14e roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110572024-12-20T22:41:19.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d8d12b9f-c08f-4c13-828b-1e9c7c00a14e resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110582024-12-20T22:41:19.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = d8d12b9f-c08f-4c13-828b-1e9c7c00a14e response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110592024-12-20T22:41:20.572ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 93 reason = Timeout
110602024-12-20T22:41:20.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110612024-12-20T22:41:20.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110622024-12-20T22:41:20.573ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 93 reason = Timeout
110632024-12-20T22:41:20.573ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110642024-12-20T22:41:20.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110652024-12-20T22:41:20.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110662024-12-20T22:41:20.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110672024-12-20T22:41:20.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110682024-12-20T22:41:20.576ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.668101ms iteration = 93 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
110692024-12-20T22:41:20.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
110702024-12-20T22:41:20.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110712024-12-20T22:41:20.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110722024-12-20T22:41:20.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110732024-12-20T22:41:20.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110742024-12-20T22:41:20.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110752024-12-20T22:41:20.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e, lookup_type: ById(d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e) } result = Ok(())
110762024-12-20T22:41:20.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110772024-12-20T22:41:20.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110782024-12-20T22:41:20.592ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e original_time_created = 2024-12-20 22:25:52.529820 UTC target_id = d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e time_created = 2024-12-20 22:25:52.529820 UTC
110792024-12-20T22:41:20.592ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.440584ms iteration = 93 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"d1f524b0-0fc0-41ed-9b32-07c3c7f7a01e","time_created":"2024-12-20T22:25:52.529820Z"}
110802024-12-20T22:41:20.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c1c0f4e4-17b1-497b-a902-480834df8e08 roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110812024-12-20T22:41:20.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c1c0f4e4-17b1-497b-a902-480834df8e08 resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110822024-12-20T22:41:20.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1888 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = c1c0f4e4-17b1-497b-a902-480834df8e08 response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110832024-12-20T22:41:21.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4b8a7a16-3655-46fe-92bb-fca043e4872f roles = RoleSet { roles: {} } uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110842024-12-20T22:41:21.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4b8a7a16-3655-46fe-92bb-fca043e4872f resource = Database result = Ok(()) uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4
110852024-12-20T22:41:21.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63920 req_id = 4b8a7a16-3655-46fe-92bb-fca043e4872f response_code = 200 uri = /probes/60382741-4b2a-4c29-94f6-25f67f5ab7e4